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(54) Moving picture decoding circuit 

(57) When a macro block (MB) synchronizing signal 
(MBSYNC) indicating starting of processing is asserted 
in processing of one processing section which Is formed 
by a macro block header and a macro block, block data 
of the macro block (MB) are decoded in synchronization 
with the assertion of MBSYNC, and next macro block 
header information is analyzed in continuation in the 



processing section. The assertion of the next MB syn- 
chronizing signal is stopped until prescribed conditions 
are established. Processing of the block data of the 
macro blocks is regularly executed from starting of one 
processing section, whereby utilization efficiency of 
operational processors is improved. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to a picture 
decoding circuit for expanding compressed picture data 
and restoring uncompressed picture data, and more 
particularly, it relates to a moving picture decoding cir- 
cuit for expanding picture data which are compressed in 
accordance with a moving picture compression system 
employing orthogonal transformation and inter- 
frame/inter-field predictive encoding. 

Description of the Background Art 

[0002] There has been proposed a system of 
encoding an enormous quantity of picture data in high 
efficiency to reduce the amount of data for transmission 
and decoding the transmitted picture data encoded in 
high efficiency thereby restoring the original pictures. 
Such picture data processing systems include the 
IVIPEG (moving picture experts group) standard, which 
is directed to moving pictures. While the system of 
encoding pixel data under the MPEG standard is well 
known in the art, the system of encoding picture data 
along the MPEG standard is now described, in orderto 
facilitate understanding of the background of the 
present invention. 

[0003] Fig. 27 schematically illustrates the structure 
of a general picture data encoding unit along the MPEG 
standard. Referring to Fig. 27. the encoding unit 
includes a subtracter 1000 which obtains difference 
between input pixel data and corresponding pixel data 
(reference pixel data) of a predicative picture, a DCT 
converter 1002 performing discrete cosine transforma- 
tion (DCT) processing, which Is one of orthogonal trans- 
formation processing methods, on a signal (prediction 
error signal) outputted from the subtracter 1000, and a 
quantizer 1004 which quantizes a signal (DCT coeffi- 
cient) outputted from the DCT converter 1 002. 
[0004] As described later in detail, pictures include 
various types such as I, P and B pictures, and prediction 
systems are varied depending on the types of the pic- 
tures. The I pictures are subjected to intra-frame or 
intra-field encoding, so that input pixel data themselves 
are encoded. The P pictures are subjected to inter- 
frame or inter-field predictive encoding from past repro- 
duced pictures. The B pictures are predicted through 
either or both of past reproduced pictures and future 
reproduced pictures (frame or field). The B pictures are 
predictively encoded (prediction-encoded) using the I 
and P pictures. The B pictures are not employed as ref- 
erence pictures. 

[0005] In the case of inter-frame or inter-field pre- 
diction, motion compensation is carried out. Blocks in 
prediction pictures having the highest correlation with 



blocks (segments serving as processing units) of the 
current picture are obtained so that predictive encoding 
is carried out using the blocks having the highest corre- 
lation, uispiacemenis beiween the currenl emu picCiiC- 
5 tion picture blocks are obtained as motion vectors, 
which are appended to respective pixel data blocks and 
transmitted. In general, the motion compensation is 
executed in units of blocks (segments) of 16 by 16 pix- 
els. 

10 [0006] The DCT converter 1 002 generally executes 
DCT processing in units of blocks of 8 by 8 pixels. Spa- 
tial redundancy (high correlation between adjacent pix- 
els) in the pictures is reduced by the DCT processing. 
Namely, it is possible to make DCT coefficients localized 

15 in a low-frequency coefficient region by carrying out the 
DCT processing In the DCT converter 1002, thereby 
enabling reduction of the picture data quantity through 
processing by quantizer 1004 at the next stage. 
[0007] In a quantization table 1012, great values 

20 are set for high-frequency components. The quantizer 
1004 quantizes the DCT coefficients received from the 
DCT converter 1002 with reference to the quantization 
table 1012, whereby low-frequency components can be 
increased in value and high-frequency components can 

25 be substantially zeroed in both of horizontal and vertical 
directions in the spatial frequencies. Thus, the data 
quantity is reduced. 

[0008] The encoding unit further includes a zigzag 
scanner 1006 which sequencizes the quantized data 

30 received from the quantizer 1 004 in prescribed order in 
a zigzag fashion, a variable length encoder 1008 which 
variable-length encodes the data received from the zig- 
zag scanner 1008, and a transmission encoding circuit 
1010 which receives the variable-length encoded data 

35 from the variable length encoder 1008, motion vector 
information from a motion vector detector (not shown) 
and information indicating attributes of other blocks and 
variable-length encodes the motion vector information 
and the attribute information in accordance with a pre- 

40 scribed format for outputting while adding error code 
words etc. thereto. 

[0009] As shown in a block 1015 on the left side of 
Fig. 27, the zigzag scanner 1006 sequencizes 8 by 8 
DCT coefficients in a zigzag manner successively from 

45 the upper left portion to the lower right portion (i.e., high- 
frequency component region). Among the DCT coeffi- 
cients shown in the DCT coefficient block 1015 of Rg. 
27, the uppemnost left one is called a DC coefficient 
indicating the average value of data of block of 8 by 8 

50 pixels, while the remaining DCT coefficients are called 
AC coefficients. Nonzero coefficients are efficiently 
caught by zigzag-scanning the DCT coefficients lay the 
zigzag scanner 1006. 

[0010] The variable length encoder 1008 succes- 
55 sively two-dimensionally variable-length encodes the 
quantized DCT coefficients received from the zigzag 
scanner 1006 with respect to both the number (runs) of 
precedent zero coefficients (null coefficients) and val- 
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ues (levels) of the nonzero coefficients (significant coef- 
ficients). This variable length encoder 1008 variable- 
length encodes the quantized DCT coefficient data 
received from the zigzag scanner 1006 through a cod- 
ing table 1014 which is developed along Huffman 
codes, for example. In the quantized DCT coefficients, 
many zeros are present in high-frequency components, 
and many of significant coefficients are present in low- 
frequency components. Codes of small lengths are 
allotted to the significant coefficients while codes of 
large code lengths are allotted to quantized coefficients 
having small appearance frequencies, thereby further 
reducing the data quantity. 

[0011] Fig. 28 illustrates exemplary arrangement of 
pictures transmitted from the transmission encoding cir- 
cuit 1010 shown in Rg. 27. 13 pictures having picture 
numbers 1 to 13 are illustrated in Rg. 28. The pictures 
of Nos. 1 and 13 are I pictures, and the pictures of Nos. 
4, 7 and 10 are P pictures. Two B pictures are inserted 
between an I picture and a P picture or between a pair 
of P pictures. The I pictures are subjected to only intra- 
frame encoding with no predictive encoding. The P pic- 
tures are subjected to inter-frame or Inter-field predic- 
tive encoding (with motion compensation), and the B 
pictures are bidirectionally prediction-encoded (with 
motion compensation), for example. The I pictures (I), 
the P pictures (P) and the B pictures (B) may be field 
pictures, or frame pictures. In prediction of the B pic- 
tures (B), interpolation is carried out with I and P pic- 
tures or P pictures which are precedent and subsequent 
thereto in time base, for example. The P pictures are 
subjected to predictive encoding (with motion compen- 
sation) with I pictures (1) or P pictures (P) which are 
precedent thereto in time base. Only the I and P pic- 
tures are employed as predictive pictures, while the B 
pictures (B) are not employed as predictive pictures. 
[0012] Fig. 29 illustrates the structure of one pic- 
ture. Refen-ingto Fig. 29, a single picture (field or frame) 
1 020 is divided into a plurality of segments called macro 
blocks. For the purpose of simplification, the picture 
1020 is divided into 32 macro blocks MB#1 to MB#32 in 
Fig. 29, for example. Processing of a moving picture is 
executed In units of the segments called macro blocks 
(in both of encoding and decoding). Each of the macro 
blocks MB#1 to MB#32 generally includes 256 pixels 
which are arranged in horizontal 1 6 pixels by vertical 16 
pixels. Therefore, the picture shown in Fig. 29 Is formed 
by 1 28 by 64 pixels. 

[DDI 3] Fig. 30 schematically illustrates the structure 
(syntax) of a bit stream (plural bit widths) of picture data. 
Referring to Fig. 30, the bit stream is divided into a plu- 
rality of layers including a sequence layer, a GOP (group 
of pictures) layer, a picture layer, a slice layer, a macro 
block layer and a block layer. 

[0014] The block layer Is fornied by a block 1100 
including a region 1100a including DCT coefficients, 
and a region 1 1 00b storing an End Of Block (EOB) indi- 
cating an end of the block. The region 1100a stores 



DCT coefficient data of pixels of 8 rows and 8 columns 
serving as a unit of DCT processing. If the final AC coef- 
ficient of the region 1 1 00a is a nonzero coefficient in this 
block 1100, the end of block of the region 1100b may 

5 not be employed. 

[0015] The macro block includes a prescribed 
number of (six) blocks 1 1 00. The macro block on the bit 
stream Includes data blocks formed by the blocks 1 1 00, 
and a macro block header 1115 for variable- length 

10 encoding and storing data attributes, a motion vector 
etc. of the data blocks. 

[0016] The slice layer includes slices 1120, each of 
which is formed by one or a plurality of macro blocks 
1 100 concatenated in picture scan order. A slice header 

75 1 125 storing information indicating a vertical position of 
the slice on the screen and Information such as a start 
code having a prescribed pattern indicating starting of 
the slice is provided at the head of the slice 1 120. This 
slice layer, which Is the lowermost layer among those to 

20 which codes of prescribed patterns are allotted, Is 
employed as the unit of resynchronization in error gen- 
eration. 

[0017] The picture layer includes pictures 1130, 
each of which is formed by a plurality of slices 1 120. A 

25 picture header 1135 storing information indicating the 
type of the picture (I picture, P picture etc.) and informa- 
tion such as a start code Indicating starting of the pic- 
ture in a variable length symbol (variable length code 
word) is an^nged at the head of the picture 1 1 30. 

30 [0018] The GOP layer includes GOPs 1140 each 
including a plurality of pictures 1130. Each of the pic- 
tures 1 130 included in each GOP 1 140 includes at least 
one I picture and zero or a plurality of P or B pictures. A 
GOP header 1145 storing Information such as a GOP 

35 start code, a flag indicating that this GOP requires no 
reference from picture data of a precedent GOP etc. is 
arranged at the head of the GOP 1 1 40. 
[0019] " The sequence layer includes sequences 
1 150, each of which is formed by one or a plurality of 

40 GOPs 1140 or one or a plurality of pictures 1130. A 
sequence header 1155 storing information such as the 
screen format is arranged at the head of the sequence 
1150. This sequence header 1155 can be arranged at 
the head of every GOP 1 140 included in the sequence 

45 1 150 (for allowing reproduction of pictures from an inter- 
mediate stage of the sequence). The sequence header 
1155 stores information such as a start code having a 
prescribed pattern indicating starting of the sequence, 
horizontal and vertical sizes of the pictures, a picture 

so rate (picture display rates), a bit rate and contents 
thereof etc. 

[0020] Fig. 31 illustrates the relation between each 
picture and the slices. As shown In Fig. 31, a single pic- 
ture 1 130 includes a plurality of slices 1120. The slice 
55 1 120, which can have an arbitrary length, returns to the 
left end upon reaching the right end on the screen. 
[0021] Fig. 32 Illustrates the data block structure of 
each macro block 1110. The macro block 1 100 includes 
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regions 1 1 0Oaa to 1100ad storing DCT coefficient data 
Y1 to Y4 for regions obtained by dividing tlie macro 
block into four portions, and blocl<s 1 lOOae and 1 1 0Oaf 
including subsampled chrominance signals Cb5 and 
Cb6 respectively. The chrominance blocks 1 1 0Oae and 
1 1 0Oaf are subsampled in the vertical and horizontal 
directions, whereby the four luminance blocks 1 1 0Oaa 
to llOOad and one chrominance block 1100ae (or 
HOOaf) have the same dimensions on the screen. 
Motion compensation Is executed in units of the macro 
blocks 1110 (MB) each of 16 by 16 pixels, while DCT 
processing is executed in units of blocks each of 8 by 8 
pixels. 

[0022] Fig. 33 schematically illustrates the structure 
of a conventional picture decoding circuit 1200. The pic- 
ture decoding circuit 1200 shown in Fig. 33 expands 
picture data which are encoded by the encoding unit 
shown in Fig. 27 and restores the original picture data. 
[0023] Referring to Fig. 33, the picture decoding cir- 
cuit 1200 includes a FIFO interface 1210 receiving an 
incoming bit stream (plural bit width) and storing/read- 
ing the same in/from an external memory 1230 in a 
FIFO (first-in first-out) fashion, a variable length decoder 
1212 variable-length decoding pixel data which are sup- 
plied through the FIFO interface 1210 in units of seg- 
ments (macro blocks) and generating quantized DCT 
coefficient data (quantized indices) of fixed length data, 
an inverse quantizer 1214 inverse-quantizing the data 
outputted from the variable length decoder 1212 and 
generating DCT coefficient data, a scan converter 121 6 
sequencing the data outputted from the inverse quan- 
tizer 1 21 4 for generating DCT coefficient data which are 
arranged in scan order, an inverse discrete cosine con- 
verter 1218 executing inverse discrete cosine transfor- 
mation, which is one of inverse orthogonal 
transformation methods, on the data outputted from the 
scan converter 1216, and a pixel reconfigurator 1220 
receiving pixel data (differential data) outputted from the 
inverse discrete cosine converter 1218 and predictive 
picture pixel data supplied from the external memory 
1230 through a memory interface 1224 for restoring 
(reconfigurating) original pixel data. 
[0024] The FIFO interface 1 21 0 accesses the exter- 
nal memory 1 230 through the memory interface 1 224 to 
store/read the incoming bit stream in the FIFO fashion 
thereby buffering the incoming bit stream and eliminat- 
ing difference between the bit rate thereof and the data 
processing rate in the picture decoding circuit 1200. 
[0025] The variable length decoder 1212 detects 
headers of respective layers from the bit stream sup- 
plied through the FIFO interface 1210. analyzes the 
detected headers, and executes data processing of 
respective blocks (blocks included in macro blocks) in 
accordance with the results of the analysis. Thus, the 
variable length decoder 1212 executes a header analy- 
sis operation and variable length decoding processing 
of quantized DCT coefficients. This variable length 
decoding processing includes processing of restoring 
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quantized DCT coefficients of fixed lengths from varia- 
ble-length encoded run-length data. 
[0026] The inverse quantizer 1214 inverse-quan- 
tizes the quantized DCT coefficients received from the 

5 variable length decoder through quantized data of a 
quantization table (quantization matrix: not shown) to 
restore or reconstruct the DCT coefficients. This quanti- 
zation matrix may be written in a quantization table 
which is included in the inverse quantizer 1214 through 

10 the variable length decoder 1212. 

[0027] The scan converter 1216 receives zigzag- 
scanned DCT coefficient data, shown in Fig. 27, which 
are supplied from the inverse quantizer 1214, and re- 
arranges the scan order thereof to the original order. 

15 The inverse discrete cosine converter 1218 performs 
inverse discrete cosine transformation processing on 
the DCT coefficient data which are supplied from the 
scan converter 1216, and restores prediction-encoded 
data. The pixel reconfigurator 1220 reads necessary 

20 prediction picture pixel data from the extemal memory 
1230 through the memory interface 1224 in accordance 
with motion vector data and macro block attribute data 
from the variable length decoder 1 21 2, adds up the read 
pixel data with the differential pixel data supplied from 

25 the inverse discrete cosine converter 1218 to reconfig- 
ure original pixel data, and restores the original pixel 
data for storing the same in the externa! memory 1230 
through the memory interface 1224. 
[0028] The processing in the pixel reconfigurator 

30 1220 is varied in correspondence to the I, P and B pic- 
tures. In the case of pixel data of pictures such as I pic- 
tures which are subjected to intra-frame encoding, pixel 
data supplied from the inverse discrete cosine converter 
1218 are picture data themselves and no predictive 

35 encoding is carried out, and hence the pixel reconfigu- 
rator 1 220 writes the pixel data which are supplied from 
the inverse discrete cosine converter 1218 in the exter- 
nal memory 1230 through the memory interface 1224. 
in case of pixel data of P or B pictures which are sub- 

40 jected to inter-frame or inter-field predictive encoding, 
pixel data which are supplied from the inverse discrete 
cosine converter 1218 to the pixel reconfigurator 1220 
are prediction error signals which are provided by the 
difference with reference to already decoded pixel data 

45 (predictive picture data), in this case, therefore, the pixel 
reconfigurator 1220 adds up corresponding predictive 
picture pixel data from the external memory 1230 and 
the pixel data from the inverse discrete cosine converter 
121 8 with each other, and writes the results of the addi- 

50 tion in the external memory 1230 through the memory 
interface 1224 again. 

[0029] The picture data written in the external mem- 
ory 1230 are read in the raster scan order through the 
memory interface 1224, and supplied to a display unit 
55 through a picture display control circuit (not shown) 
through a pixel bus interface 1222. 
[0030] The aforementioned series of processing is 
executed in units of segments, similarly to the case of 
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encoding. The inverse quantizer 1214, the scan con- 
verter 1 21 6, the inverse discrete cosine converter 1 21 8 
and the pixel reconfigu rater 1220 are pipelined, in order 
to process the picture data at a high speed. 
[0031] A control circuit 1226 controls the access to s 
the external memory 1230 and starting and stoppage of 
the pipeline stage. 

[0032] Fig. 34 illustrates storage areas of the exter- 
nal mennory 1230 shown in Fig. 33. This external mem- 
ory 1230 is formed by a DRAM (dynamic random io 
access memory), for example, and includes a FIFO 
area 1232 storing an externally supplied bit stream in 
the FIFO fashion, a reference picture area 1234 storing 
reference (prediction) picture pixel data employed for 
prediction decoding (DPCM decoding) processing in the is 
pixel reconfigurator 1 230 (Fig. 33), and a display picture 
area 1236 storing display picture data to be displayed 
on a display unit through the display control circuit (not 
shown in Rg. 33). The FIFO area 1230 is generally 
called a rate buffer for rate adjustment for absorbing dif- 20 
ference between the bit rate of the incoming bit stream 
and the data processing speed in the picture decoding 
circuit 1200 (Fig; 33). Due to the employment of the 
FIFO area 1232, it is possible to compensate for differ- 
ence in code quantity required in a unit time in picture 25 
expansion processing due to processing of variable 
length code word data while the transmission rate of the 
incoming bit stream is kept substantially constant. 
[0033] ^ Fig. 35 illustrates an exemplary timing chart 
in relation to control of the picture decoding circuit 30 
shown in Fig. 33. This figure shows a picture synchro- 
nizing signal which is a synchronizing signal indicating 
starting of an operation in units of frame or field pictures, 
and an MB synchronizing signal which is a synchroniz- 
ing signal indicating starting of an operation in units of 35 
segments. The picture synchronizing signal, which is a 
vertical synchronizing signal, for example, is supplied to 
the control circuit 1226 shown in Rg. 33 from the display 
control circuit (not shown). The control circuit 1226 out- 
puts the MB synchronizing signal in synchronization 40 
with the picture synchronizing signal. The cycle of the 
picture synchronizing signal has a constant value which 
is decided by a display rate of decoded picture data 
(pixel data read through the pixel bus interface 1222 
shown in Fig. 32) on the display unit. This display rate is 45 
decided by a level in the MPEG standard. The maxi- 
mum values of the number of horizontal pixels, the 
number of vertical pixels and the frame frequencies are 
standardized in the "level". In a single picture, the 
number of divided macro blocks is previously deter- so 
mined. Therefore, the number of MB synchronizing sig- 
nals asserted in a picture synchronizing signal cycle is 
determined by the pixel number of the picture, I.e., the 
number of macro blocks in a single picture. This MB 
synchronizing signal is supplied to each circuit of the ss 
picture decoding circuit 1220 from the control circuit 
1226 shown in Fig. 33, so that each circuit executes pre- 
scribed processing synchronously. 
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[0034] Fig. 36 is a timing chart showing processing 
which is carried out in a segment unit processing sec- 
tion. This figure shows the picture decoding circuit as a 
decoder. An operation of this picture decoding circuit 
(decoder) is started in synchronization with the MB syn- 
chronizing signal. The variable length decoder 1212 
(see Rg. 33) is activated in synchronization with the MB 
synchronizing signal to detect and analyze headers 
from the bit stream supplied through the FIFO interface 
1210. thereby deciding the processing to be subse- 
quently executed. Then, decoding of actual data (here- 
inafter referred to as decoding of block data) . of 
respective blocks of macro blocks is carried out in 
accordance with the processing operation decided by 
the header analysis. 

[0035] In parallel with the decoding operation in the 
decoder, executed is access to the external memory 
1230, including writing of the bit stream in the FIFO area 
1232 shown in Rg. 34, reading of pixel data from the 
FIFO area 1232 as to the bit stream to be decoded, writ- 
ing of the decoded picture data in the reference picture 
area 1234 or the display picture area 1236 (B pictures 
are not employed as reference (prediction) pictures), 
reading of data from the display picture area 1236 of the 
external memory for display of the picture data, and 
reading of predicting picture data employed for predic- 
tive encoding/decoding processing in the pixel reconfig- 
urator 1 220 from the reference picture area 1 234. 
[0036] Fig. 36 also shows the processing operation 
of a single macro block. In the following description, it is 
assumed that the term "segment" includes both of a 
macro block including a plurality of blocks, and a macro* 
block header including attribute data of the macro block, 
and the term "macro block" simply includes a plurality of 
data blocks. 

[0037] A header analysis part decodes a header 
part of the segment, and decides processing to be sub- 
sequently executed and attributes of the macro block to 
be processed. After the decoding of the header part of 
the macro block, luminance signals (Y signals) and 
chrominance signals Gb and Or of respective blocks of 
the macro block are decoded. At this time, an operation 
of reconfiguring motion vectors from those obtained by 
the decoding of the macro block header part is carried 
out in parallel (a plurality of motion vectors are 
employed in the case of B pictures). An exemplary 
decoding operation of such a decoder Is described in "A 
Single-Chip MPEG2 Video Decoder LSI" by Demura et 
al., ISSGC 94, Digest of Technical Papers, pp. 72 to 73, 
Fig. 2, for example. In the case of this processing, there- 
fore, the time required for the header analysis depends 
on the length of the header part, and hence the period 
of the MB synchronizing signal, i.e., the time length of a 
single processing section differs for different processing 
sections. 

[0038] In the picture decoding circuit, the bit stream 
is processed in units of segments. As shown in Fig. 30, 
headers are provided on heads of the respective layers 
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excluding the block layer. Start codes indicating starting 
of the layers are an^nged on the head portions of the 
headers. Each start code 1300 has a width of 32 bits 
which are arranged in units of bytes, as shown in Fig. 
37. 

[0039] Referring to Fig. 37, the start code 1300 
includes a 3-byte prefix 1310 having a prescribed pat- 
tern indicating that this is a start code, and a 1-byte 
layer start code 1 320 having a pattern which is specific 
to each layer. For exannple, a start code indicating start- 
ing of a picture layer of the MPEG2 standard has the fol- 
lowing pattern: 

0000 0000 0000 0000 0000 0001 0000 0000 

while a start code indicating starting of a sequence layer 
has the following pattern: 

0000 0000 0000 0000 0000 0001 1 01 1 001 1 

In the aforennentioned start codes, the prefix is formed 
by upper 24 bits (3 bytes), and the layer start code is 
formed by a lower byte (8 bits). 

[0040] In the MPEG2 standard, header information 
is arranged following the start code in each layer which 
is higher in order than the macro blocic layer. No start 
code is arranged on the macro block layer. The header 
infomnation is fixed length data, while detailed descrip- 
tion thereof is omitted. The header (macro block 
header) of the macro block layer includes variable- 
length encoded information. 

[0041] Fig. 38 illustrates an exemplary structure of 
a macro block header 1350. Referring to Fig. 38, the 
macro block header 1350 includes a macro block 
address area 1352 storing information (a macro block 
address) indicating the position of the macro block on 
the screen and the number of macro blocks to be 
skipped (macro block address increment), an area 1 354 
storing a macro block type indicating a method of 
processing the macro block, an area 1356 storing 
motion vectors of the macro block, and a CBP area 
1358 storing CBP (coded block pattern) indicating 
whether or not respective blocks of the macro block 
other than in I pictures include DCT coefficient data. 
[0042] The macro blocks which are skipped by the 
macro block address increment are those having no 
codes of DCT coefficients among those subjected to no 
motion compensation as to P pictures, for example. The 
macro block type stored in the area 1354 includes infor- 
mation as to whether or not the macro block is sub- 
jected to intra-frame/intra-field predictive encoding, 
whether or not the same is subjected to motion compen- 
sation, and the like. 

[0043] The motion vector area 1356 stores motion 
vectors in the case of motion compensated prediction. 
In the case of I pictures, no motion vectors are stored in 
the motion vector area 1356. In relation to P pictures, on 
the other hand, motion vectors along a prediction sys- 
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tern (odd and even fields (top and bottom fields) in the 
case of frame predictive encoding system) can be 
employed. Also as to B pictures, the number of 
employed motion vectors varies according to the predic- 

5 tion system. Therefore, the bit width of the motion vector 
storage area 1356 differs for different segment. There- 
fore, a block as to which the information stored in the 
CBP area 1358 indicates inclusion of no DCT coefficient 
data is absent in data transmission. 

10 [0044] The information included in the respective 
areas 1352, 1354, 1356 and 1358 of the macro block 
header 1350 is entirely expressed by variable length 
code words (variable length symbols). Therefore, the 
time required for entirely analyzing the information of 

15 the macro block header 1350 varies according to the 
attributes of the macro blocks (the method of process- 
ing, the number of the motion vectors etc.). 
[0045] It is possible to specify what processing is 
carried out on the macro block following the macro block 

20 header 1350 by analyzing the header information. In 
general, analysis of the information of the macro block 
header 1350 is started in synchronization with the MB 
synchronizing signal (MBSYNC) as shown in Fig. 36, so 
that decoding of the macro block data is performed only 

25 after the information of the macro block header 1350 is 
entirely analyzed. Namely, a code decoding part of the 
variable length decoder 1212, the inverse quantizer 
1214, the scan converter 1216, the inverse discrete 
cosine converter 121 8 and the pixel reconftgurator 1220 

30 shown in Fig. 33 are kept in operation stoppage states 
after the MB synchronizing signal (MBSYNC) is 
asserted until the information of the macro block header 
1350 is entirely analyzed, and these operational proces- 
sors are brought into operating states only after the 

35 macro block header information is entirely analyzed. 
Fig. 39 illustrates such a state that headers of macro 
blocks MB#A, MB#B and MB#C are completely ana- 
lyzed at times Ta, Tb and To respectively, and then block 
data are decoded, for example. 

40 [0046] Therefore, when a long time is required for 
the header analysis in the macro block MB#C, for exam- 
ple, the operation stoppage times of the operational 
processors following the variable length code decoder 
are so increased that utilization efficiency of the opera- 

45 tional processors is reduced and the picture data cannot 
be decoded at a high speed. 

[0047] In order to prevent such reduction in utiliza- 
tion efficiency of the operational processors, the opera- 
tional processing may conceivably be carried out in a 

50 pipeline manner. 

[0048] Fig. 40 schematically illustrates a pipeline 
which is defined by respective stages of operational 
processors from an inverse quantizer to a pixel reconfig- 
urator. In the structure shown in Fig. 40, variable-length 

55 decoded data having header analyzed are dispatched 
into the pipeline every assertion of MB synchronizing 
signal MBSYNC. Inverse quantization, scan conversion, 
inverse DCT and pixel decoding stages in the pipeline 
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stages process the supplied data in a pipeline mode 
respectively. 

[0049] When header analysis and variable length 
decoding of the segment (the macro block header and 
the macro block) MB#A are completed and a next MB 
synchronizing signal MBSYNC is asserted, the respec- 
tive block data of the macro block MB#A are dispatched 
into the pipeline and successively processed. 
[0050] If a long time is required for header analysis 
of the next segment MB#B, data of the macro block 
MB#B are not yet introduced into the pipeline upon 
completion of data processing of the respective blocks 
of the macro block MB#A. Thus, vacancy is caused in 
the pipeline stages and pipeline utilization efficiency is 
reduced. 

[0051] When header analysis and variable length 
decoding of the segment MB#B are completed, the data 
of variable length decoded words of the macro block 
MB#B are dispatched into the pipeline stages in accord- 
ance with assertion of a next MB synchronizing signal 
MBSYNC. 

[0052] If header analysis of the next segment 
MB#C is completed in a short time and variable length 
decoding for data of respective blocks of the macro 
block MB#C is also quickly completed correspondingly, 
a next MB synchronizing signal MBSYNC is asserted 
following completion of the variable length decoding of 
the macro block MB#C. If data processing of the respec- 
tive blocks of the macro block MB#B is not yet com- 
pleted in tiie inverse quantization stage of the pipeline 
at this time, block data of the next macro block MB#C 
are dispatched during data processing of the respective 
blocks of the macro block MB#B. Thus, the data of the 
respective blocks of the macro blocks MB#B and MB#C 
are mixedly processed, and the data processing 
(expansion processing) cannot be correctly performed 
but breaks down. Thus, a large pipeline cannot be intro- 
duced, and improvement of utilization efficiency of the 
operational processors through the use of the pipeline is 
limited. 

[0053] In a picture decoding circuit for processing 
moving picture data, particularly data of pictures having 
a large screen size of HDTV (high definition television) 
or the like, it is necessary to process a large quantity of 
data at a high speed (the frequency of a frame or a field, 
i.e., the cycle of this picture synchronizing signal is 
decided by the display speed for the picture data after 
expansion), and the amount of operations at operational 
processors (such as an inverse DCT converter, for 
example) in the expansion procedure becomes 
extremely large. In order to compensate for reduction of 
utilization efficiency of the operational processors and 
implement high-speed data processing, therefore, it is 
necessary to increase the operating speeds of the 
respective operational processors (increase the fre- 
quencies of clock signals deciding the operational 
processing speeds). Thus, the number of on and off 
times of the elements forming the operational proces- 



sors and the number of charging and discharging times 
of signal lines per unit time are increased, leading to 
increase of current consumption. 

[0054] As another method, it is also conceivable to 
5 provide a plurality of operational processors in parallel 
with each other and simultaneously drive the same in 
parallel with each other thereby compensating for 
reduction of utilization efficiency In this case, however, 
the element number is disadvantageously increased to 
10 increase the device scale. 

[0055] When interruption processing from an exter- 
nal control unit is caused during the picture expansion 
procedure, for example, it is necessary to initialize the 
picture decoding circuit after completion of the interrup- 
ts tion. If the processing is restarted from the interrupted 
state, however, display Is performed from an intermedi- 
ate stage of the picture. In this case, it may be impossi- 
ble to synchronize processing of the subsequent picture 
with the display on the display unit. If first picture display 
20 is executed immediately after initialization in synchroni- 
zation with the picture synchronizing signal such as the 
vertical synchronizing signal, for example, pictures out 
of synchronization are thereafter displayed (boundaries 
between the pictures are displayed on the screen). In 
25 the MPEG standard, a sequence header is arranged on 
the head of each GOP (group of pictures) to allow repro- 
duction from an arbitrary GOR However, no processing 
to be executed in resetting (initialization) of the picture 
expansion procedure is mentioned. Further, no prior art 
30 mentions such an operation of initialization of picture 
expansion processing. 

SUMMARY OF THE INVENTION 

35 [0056] An object of the present invention is to pro- 
vide a picture decoding circuit which can efficiently exe- 
cute expansion of picture data. 

[0057] Another object of the present invention is to 
provide a picture decoding circuit including an efficiently 

40 operating pipeline stage. 

[0058] Still another object of the present invention is 
to provide a picture decoding circuit which is excellent in 
utilization efficiency of operational processors. 
[0059] A further object of the present invention is to 

45 provide a picture decoding circuit which can reliably 
execute processing from a first macro block of a picture 
in resetting (in initialization and re-synchronization) 
without reducing processing efficiency. 
[0060] A picture decoding circuit according to a first 

50 aspect of the present invention includes a header 
decoder receiving an incoming bit stream and analyzing 
information of a header of a segment, a controller gen- 
erating a data processing start indication signal in 
response to a signal indicating completion of analysis of 

55 the segment header information from the header 
decoder, and a data processor which is activated in 
response to the data processing start indication signal 
for executing predetermined processing on a data block 
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of the segment following the header. The header 
decoder continuously analyzes data of a header which 
is supplied following the data block, whereby one 
processing section is started from processing of the 
data block and ended in analysis of the header. 5 
[0061 ] A picture decoding circuit according to a sec- 
ond aspect of the present invention includes an ana- 
lyzer detecting a header of a segment from a supplied 
bit stream for analyzing this header information. This 
analyzer includes a circuit generating a signal indicating to 
completion of analysis of all the header information. 
[0062] The picture decoding circuit according to the 
second aspect further includes a data processor includ- 
ing a portion for generating fixed length code data by 
carrying out variable length decoding on data of a data is 
block following the header of the segment for restoring 
the data of the data block in accordance with the result 
of analysis of the analyzer, an error detector generating 
an error detection signal indicating an error which is 
detected in the processing of either the analyzer or the 20 
variable length decoder, code detector detecting a start 
code having a predetermined pattern from the incoming 
bit stream in response to the error detection signal, an 
activator activating the analyzer in response to a code 
detection signal from the code detector, and a delayer 25 
for delaying activation of the data processor until pre- 
scribed conditions are satisfied in response to an analy- 
sis completion indication signal from the analyzer in 
activation of the error detector. 

[0063] A picture decoding circuit according to a 30 
third aspect of the present invention includes a control- 
ler generating a processing start signal in response to a 
reset request signal requesting initialization of picture 
expansion processing, code detector detecting a start 
code having a predetermined pattern from an incoming 35 
bit stream in response to the processing start signal 
from the controller, a header analyzer detecting a seg- 
ment from the incoming stream in response to a code 
detection signal from the code detector in code detec- 
tion for analyzing information of its header and generat- 40 
ing a signal indicating that all analysis of the head 
infonnation is completed, and a stop control for stopping 
the operation of data processor carrying out processing 
of a data block of the segment until prescribed condi- 
tions are satisfied in response to the header analysis 45 
completion indication signal. 

[0064] In the picture decoding circuit according to 
the first aspect, the header is analyzed following decod- 
ing of the data block, and starting of data processing is 
instructed after the header is entirely analyzed. One so 
processing section is started at processing of the data 
block and ended at analysis of the header. When the 
data processing start is designated, the data processor 
immediately executes processing. Therefore, the stop 
period of the operational processor is reduced and the ss 
utilization efficiency thereof is Improved. Further, the 
standby time of the operational processor is reduced, 
whereby the time period of one processing section can 



be reduced to implement high-speed processing. 
[0065] In the picture decoding circuit according to 
the second aspect, a start code having a prescribed 
pattem is detected when an error is caused in a header 
analysis or variable length decoding process and the 
header of a segment following the start code is ana- 
lyzed, and the start of processing of a data block follow- 
ing the analyzed header is delayed until a prescribed 
condition is satisfied after completion of the analysis. 
Processing is started from a prescribed segment even 
in occurrence of an error and the processing section is 
started at processing of the data block in the restarting 
of the processing, whereby reduction of utilization effi- 
ciency of the operational processor can be also sup- 
pressed in starting of the processing after recovery from 
the error. Further, It Is possible to maintain such regular- 
ity that the processing section is started at decoding of 
the data block. 

[0066] In the picture decoding circuit according to 
the third aspect, a start code having a prescribed pat- 
tern is detected upon request for resetting, and a 
header of a segment following the start code is ana- 
lyzed and the subsequent processing is stopped until 
establishment of the prescribed condition. Also in 
request for resetting, processing can be reliably started 
from a macro block of a segment of a desired position. 
[0067] The foregoing and other objects, features, 
aspects and advantages of the present Invention will 
become more apparent from the following detailed 
description of the present invention when taken in con- 
junction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0068] 

Fig. 1 schematically illustrates an operation in one 
processing section of a picture decoding circuit 
according to the present invention; 
Rgs. 2A and 2B illustrate the structure of one 
processing section (unit) of the picture decoding cir- 
cuit according to the present Invention and an effect 
of pipeline arrangement; 

Rg. 3 illustrates the operations of one processing 
section of the picture decoding circuit and a DRAM 
port according to the present invention; 
Fig. 4 illustrates other operation sequences of the 
picture decoding circuit and the DRAM port accord- 
ing to the present invention; 

Rg. 5 illustrates structures of input and output sig- 
nals in and from an inverse quantizer which Is 
employed in the picture decoding circuit according 
to the present invention; 

Rg. 6 illustrates the relations between the input and 
output signals of the inverse quantizer shown In Fig. 
5; 

Rg. 7 illustrates a pipeline structure of operational 
processors of the picture decoding circuit according 
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to the present invention and a processing sequence 
for block data; 

Fig. 8 is a flow chart representing an operation for 
setting the time period of one processing section in 
the picture decoding circuit according to the present 5 
invention; 

Fig. 9 illustrates another operation sequence for 
deciding one processing section in the picture 
decoding circuit according to the present invention; 
Fig. 10 is a flow chart representing an operation in io 
an en'or state in the picture decoding circuit accord- 
ing to the present Invention; 

Fig. 11 illustrates the structures of a header of a 
segment and a start code accompanying the same 
employed in the present invention; is 
Fig. 12 illustrates the structure of a part of the pic- 
ture decoding circuit according to the present 
invention which is related to the operation in an 
error state; 

Fig. 13 illustrates an operation sequence of the 20 
structure shown in Fig. 12 in an error state; 
Fig. 14 illustrates another operation sequence of 
the structure shown in Fig. 12 in an error state; 
Fig. 1 5 illustrates the internal structure of a variable 
length decoder shown in Fig. 12; 25 
Fig. 16 is a block diagram showing the internal 
structure of a control unit shown in Fig. 12; 
Fig. 1 7 illustrates the structure of a pixel reconfigu- 
rator in the picture decoding circuit according to the 
present invention; 30 
Fig. 1 8 illustrates an operation sequence in an error 
state in the picture decoding circuit according to the 
present invention; 

Fig. 19 Illustrates an en^or concealment processing 

in the picture decoding circuit according to the 35 

present invention; 

Fig. 20 Illustrates another structure of the pixel 
reconfigurator in the picture decoding circuit 
according to the present invention; 
Fig. 21 illustrates the structure of a scan converter 40 
shown in Fig. 20; 

Fig. 22 illustrates still another operation sequence 
in an error state in the picture decoding circuit 
according to the present Invention; 
Fig. 23 illustrates an error concealment processing 45 
in the operation sequence shown in Rg. 22; 
Fig. 24 is a flow chart representing an operation in 
resetting (restarting) of the picture decoding circuit 
according to the present invention; 
Fig. 25 is a flow chart representing art operation in so 
resetting (inltiaiization) of the picture decoding cir- 
cuit according to the present invention; 
Fig. 26 illustrates an exemplary operation sequence 
in resetting of the picture decoding circuit according 
to the present invention; ss 
Fig. 27 illustrates a structure for generating a varia- 
ble length code which the present invention proc- 
esses; 



Fig. 28 illustrates a picture arrangement in a GOP 

layer utilized In a picture decoding circuit to which 

the present invention is applied; 

Fig. 29 illustrates the structure of picture data to 

which the present invention is applied; 

Rg. 30 illustrates the syntax of picture data to which 

the present invention Is applied; 

Rg. 31 Illustrates a slice layer shown in Fig. 30; 

Fig. 32 illustrates the structure of a block layer 

shown in Fig. 30; 

Rg. 33 is a block diagram schematically showing 
the structure of a picture decoding circuit to which 
the present invention is directed; 
Fig. 34 illustrates the structure of storage areas of 
an external memory shown in Fig. 33; 
Rg. 35 illustrates a processing section of a conven- 
tional picture decoding circuit;. 
Rg. 36 illustrates an operation of the conventional 
picture decoding circuit; 
Rg. 37 illustrates the structure of a start code; 
Rg. 38 illustrates the structure of a header part of a 
macro block layer; 

Rg. 39 illustrates a problem in the conventional pic- 
ture decoding circuit; and 

Rg. 40 illustrates another problem In the conven- 
tional picture decoding circuit. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0069] Fig. 1 illustrates an operation in one 
processing section PS1 of a variable length decoding 
part in a picture decoding circuit according to the 
present Invention. The processing section PS1 of a var- 
iable length decoding part (hereinafter referred to as a 
decoder (VLD)) includes a decoding period PS2 for 
decoding data of respective blocks of a macro block, 
and a period PS3 following the decoding period PS2 for 
analyzing header information. The decoding period PS2 
is started in response to assertion of an MB synchroniz- 
ing signal MBSYNC. to decode the block data consist- 
ing of a variable length symbol group on the basis of a 
quantization index. In the header analysis period PS3, 
information of a header part (sequence and picture 
headers may be included in addition to a macro block 
header) for a next processing section is entirely ana- 
lyzed. After completion of the analysis period PS3, i.e., 
after completion of analysis of all information of the next 
macro block header, starting of the next processing sec- 
tion PS1 , i.e., decoding processing of data of blocks of 
the next macro block, is delayed until prescribed condi- 
tions are established. Referring to Fig. 1, the block data 
of the next macro block are decoded following comple- 
tion of the analysts period PS3. However, the time 
period of the analysis period PS3 varies depending on 
the header information. Decoding processing of 
encoded block data (the data of the respective blocks of 
the macro block) is completed in a fixed constant time. 



9 



EP 1 085 465 A2 



18 



17 

The data of the respective blocks of the macro block are 
variable-length encoded, with different code lengths. 
When the variable length codes are decoded at a 1 
symbol/1 clock cycle rate, for example, each block of the 
macro block has 8 by 8 pixels, and the maximum 
number of the symbols per block is 64. When the time 
period of the decoding period PS2 is set in the afore- 
mentioned manner, therefore, a fixed time length can be 
attained. When variable-length encoding is carried out 
at the rate of 1 symbol/1 clock cycle, run-length data are 
decoded and DCT coefficients of the respective blocks 
are successively obtained along the decoded run-length 
infomnation. In this case, therefore, the maximum value 
of the time required for the run-length decoding can be 
previously determined, and if the time required for such 
run-iength decoding is previously set at a constant 
value and when DCT coefficient data of the blocks are 
obtained at a rate of one pixel per clock from the 
decoded run-length information, the time period is fixed 
also in this case. Also when the time required for the 
run-length decoding is varied and accordingly the time 
period of the decoding period PS2 fluctuates, the time 
period required for decoding the block data can be sup- 
pressed within a constant time (about the maximum 
decoding time). The decoder (VLD) outputs DCT coeffi- 
cients (quantization index) of fixed lengths. 
[0070] According to the structure of the processing 
period shown in Fig. 1, the following advantages are 
obtained: The data of the blocks of the macro block are 
decoded in synchronization with the MB synchronizing 
signal MBSYNC. Tlierefore, each computing element 
included in the picture decoding circuit can start its 
operation after completion of header analysis with no 
standby time. Therefore, an inverse quantizer, a variable 
length decoder, a scan converter, an inverse discrete 
cosine converter and a pixel reconfigurator can start 
processing with no delay (particularly when the ele- 
ments construct a pipeline), whereby utilization effi- 
ciency of various computing elements of the picture 
decoding circuit can be Improved. 
[0071] Further, the time periods of the decoding 
period PS2 and the analysis period PS3 can be remark- 
ably reduced by driving various operational processors 
included in the picture decoding circuit In a pipeline 
manner as described later. 

[0072] Figs. 2A and 28 specifically illustrate the 
structure of each processing section. Referring to Fig. 
2A, the decoding period PS2 of one processing section 
includes variable length decoding processing (VLD) for 
variabie-length decoding variable length codes and 
generating quantized DCT coefficients of fixed lengths, 
inverse quantization processing (IQ) on the variable- 
length decoded DCT coefficient data, scan conversion 
processing carrying out conversion of scan order of the 
inverse-quantized DCT coefficients, inverse discrete 
cosine transformation processing (IDCT) of the scan- 
converted data, and pixel restoration processing 
(DPCM: differential PCM) for restoring original pixel 



data from the pixel data after the inverse discrete cosine 
transfomriatlon, Refen-lng to Rg. 2A, the time period of a 
decoding period in the processing section is the total 
sum of times required for the respective processing 

5 operations. 

[0073] Fig. 2B illustrates an exemplary structure In 
the case of executing the respective processing opera- 
tions included in the decoding period 2 in a pipeline 
manner. When the variable length decoding processing 

10 (VLD) is completed, the header information can be ana- 
lyzed In the variable length decoder. Therefore, header 
information of a next segment can be analyzed in paral- 
lel with the inverse quantization processing (IQ), the 
scan conversion processing (write/read of data to a 

75 buffer memory, accompanying address conversion), the 
inverse discrete cosine transformation processing 
(IDCT) and the pixel restoration processing (DPCM). 
Thus, reduction of the time periods of the decoding 
period PS2 and the analysis period PS3 can be imple- 

2o mented by carrying out the processing in the pipeline 
mode due to parallel processing of the header informa- 
tion analysis and decoding of block data through the 
pipeline, the time period for one processing section can 
be remarkably reduced, and high-speed arithmetic 

25 processing (expansion) can be executed. The structure 
of the pipeline is described later again In detail. 
[0074] The external structure of the picture decod- 
ing circuit according to the present invention is schemat- 
ically identical to the structure shown in Fig. 33. Internal 

30 Structures of a variable length decoder 1 21 2 and a con- 
trol circuit 1226 are different. These structures are 
described later in detail. 

[0075] Fig. 3 illustrates operations of the decoder 
(picture decoding circuit) and a port of an external mem- 
35 ory device (DRAM). Referring to Fig. 3, decoding of 
block data of the segment is started in response to 
assertion of the MB synchronizing signal MBSYNC in 
the picture decoding circuit (decoder). When the decod- 
ing of the block data is completed, header information of 
40 the next segment Is analyzed. One processing unit time 
period is just ended when analysis of the header Infor- 
mation is completed, and decoding of block data of the 
macro block of the next segment is started. 
[0076] With respect to the DRAM, on the other 
45 hand, pixel data decoded in a precedent processing unit 
time period (section) are first written in response to 
assertion of the MB synchronizing signal MBSYNC. 
Then, an externally supplied bit stream is written in a 
predetermined time period through the FIFO interface 
50 1210 shown in Rg. 32. When the writing of the bit 
stream in the DRAM port (writing in a rate buffer) is 
completed, picture data for display are then read out. 
When the reading of the picture data for display (pixel 
data of the macro block, for example) is completed, pre- 
ss dictive picture data employed for restoration of predic- 
tion encoded pixel data are then read out. In such 
reading of the predictive picture data, picture data of two 
pictures which are precedent and subsequent in time 
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are read in the case of Interpolation prediction, for 
example, in the case of B pictures. Therefore, the read- 
ing of the predictive picture data varies depending on 
the encoding nnode of the block data to be decoded. 
[0077] When the reading of the predictive picture 5 
data is completed, the bit stream to be processed is 
then read out (reading of the rate buffer). In the reading 
of the rate buffer, the quantity of read data is previously 
set. It is necessary that the bit stream employed for 
analysis of the header infomiation in the processing unit io 
carrying out reading of the rate buffer and the blocl^ data 
of the segment decoded in the next processing unit 
(section) are prepared in a buffer included in the varia- 
ble length decoder which is described later. It is possible 
to guarantee storage (prefetch) of the bit stream is 
employed for the header analysis In the corresponding 
processing section and the block data employed in the 
next processing section in a buffer memory included in 
the variable length decoder by reading the bit stream 
from the rate buffer in each processing (unit) section. 20 
Here, one processing unit corresponds to one process- 
ing section. 

[0078] After the reading of the rate buffer, DRAM 
refreshing is carried out, and refreshing of memory data 
stored in the DRAM which is an external memory device 25 
is executed. In the operation of the DRAM port, the 
aforementioned operations are successively executed 
in a single processing unit time. In the operation 
sequence shown in Rg. 3, no access is made until the 
next processing section is started after completion of 30 
the DRAM refreshing operation, and the DRAM port 
enters an empty (wait) state. The DRAM refreshing is 
illustrated as being carried out last in one processing 
section. However, this DRAM refreshing may be exe- 
cuted at proper timing in the section of one processing 35 
unit 

[0079] Fig. 4 illustrates another sequence of opera- 
tions of the picture decoding circuit and the DRAM port 
in one processing section. Referring to Fig. 4, decoding 
of the block data (data of the respective blocks of the 40 
macro block) is earned out in the picture decoding cir- 
cuit (decoder) in synchronization with assertion of the 
MB synchronizing signal MBSYNC similarly to the 
sequence shown in Rg. 3, and then header information 
of the next segment is carried out after completion of the 45 
decoding. In the sequence shown in Fig. 4, starting of 
decoding processing of the block data of the next seg- 
ment Is delayed after completion of analysis of the 
header information. 

[0080] In the DRAM port on the other hand, writing so 
of decoded data, writing in the rate buffer, reading of 
picture data for display, reading of predictive picture 
data and reading of the rate buffer are successively exe- 
cuted in synchronization with assertion of the MB syn- 
chronizing signal MBSYNC. DRAM refreshing is ss 
executed before the reading of the rate buffer This 
DRAM refreshing can be executed in one processing 
section at arbitrary timing, as described above. One 



processing section is completed by completion of the 
reading of the rate buffer. In response to the completion 
of the processing section, the MB synchronizing signal 
MBSYNC is asserted in order to instruct starting of 
decoding of the block data of the next segment An 
empty period between the analysis of the head informa- 
tion and the starting of decoding of the next block data 
is described later in detail. 

[0081] The writing of the decoded data, the writing 
in the rate buffer, the reading of the picture data for dis- 
play, the reading of the predictive picture data and the 
reading of the rate buffer are carried out with respect to 
the DRAM port in the prescribed order in this process- 
ing section, whereby it is not necessary to discriminate 
the priority of the accesses to the DRAM or to provide a 
bus arbiter for adjusting the accesses to the DRAM, and 
the device structure is simplified. 

[0082] Further, it is possible for the processing 
operations to be adapted for the pipeline structure of the 
operational processors of the picture decoding circuit 
described later in detail, by writing the decoded data 
first in the processing section. In addition, it is possible 
to prepare picture data which are necessary for the sub- 
sequently executed reading of the picture data for dis- 
play in the DRAM by writing the decoded data In 
advance. Namely, the decoded data are immediately 
displayed in the case of B pictures (the B pictures are 
not employed as predictive pictures). It is possible to 
write the bit stream in the rate buffer without changing 
the operation mode (write mode/read mode) of the 
DRAM and with no delay of the externally supplied bit 
stream by writing the bit stream in the rate buffer subse- 
quently to the writing of the decoded data. It is not nec- 
essary to stall the operation of the display control unit 
which is separately provided in the exterior, since the 
picture data for display are read in advance of the read- 
ing of the predictive picture data. Namely, the number of 
the predictive pictures to be read varies depending on 
the processing method (predictive encoding) for the 
segment in the reading of the predictive picture data. 
Therefore, the time required for completion of the read- 
ing of the predictive picture data varies with the type of 
picture. Thus, it is possible to supply the display picture 
data to the display control unit substantially at the same 
timing In each respective processing section by reading 
the picture data for display in advance of reading of the 
predictive picture data having a different timing of com- 
pletion in one processing section, and utilization effi- 
ciency of the display control unit is not damaged. 
[0083] The bit stream is read from the rate buffer at 
the last of the processing section with no problem, since 
only supply to the variable length decoder (1212: see 
Fig. 33) of a bit stream which is required for block data 
decoding processing and header analysis in the next 
section is required. The predictive picture data are read 
in advance of the reading of the rate buffer, so that the 
predictive picture data can be reliably loaded In the 
buffer memory which is provided in the pixel reconfigu- 
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rator of the picture decoding circuit and the arithmetic 
processing of forming the predictive pictures can be reli- 
ably executed subsequently in synchronization with 
starting of the next processing section. 
[0084] The access to the DRAIS4 port is started in 
synchronization with the MB synchronizing signal 
MBSYNC, whereby the read timing for the predictive 
picture data can be previously predicted and bus control 
is simplified (access control to the DRAM is carried out 
by the control circuit 1226 shown in Fig. 32, the struc- 
ture of which is described later in detail). Namely, it is 
possible to recognize the type of the macro block and its 
position on the screen by analyzing the header informa- 
tion in advance. The DRAM has the structure of a frame 
memory. Therefore, it is possible to previously predict 
change of row addresses etc. in the writing of the 
decoded data and the reading of the picture data for dis- 
play by analyzing the header information in advance, 
whereby the times required for the writing of the 
decoded data and the reading of the picture data for dis- 
play can be predicted in response and the read timing 
for the predictive picture data can be predicted in 
response. Thus, control of the memory interface shown 
in Fig. 32 and the loading operation of the predictive pic- 
ture data in the pixel reconflgu rator can also be arbltrat- 
edly carried out 

[0085] Fig. 5 schematically illustrates the structure 
of the inverse quantizer forming the pipeline in units of 
clock cycles. This inverse quantizer 1214 receives 
quantized DCT coefficient data consisting of variable- 
length decoded fixed length data through an input bus 
A101 while receiving an input synchronizing signal indi- 
cating starting of each block (each block of the macro 
block) through a signal line A103, carries out inverse 
quantization processing in a pipeline mode, and outputs 
DCT coefficient data from an output bus A1 02 while out- 
putting an output synchronizing signal indicating start- 
ing of the block of the output data through a signal line 
A104. 

[0086] The inverse quantizer 1214 carries out arith- 
metic processing inverse to that in quantization on the 
quantized DCT coefficients which are converted to fixed 
length codes using a previously prepared quantization 
table (for example, it carries out multiplication with cor- 
responding coefficients of the quantization table: when 
division is made by corresponding coefficients of the 
quantization table in quantization). At this time, multipli- 
cation processing is executed in a pipeline manner. In 
general, this inverse quantizer 1214 comprises a pipe- 
line having 128 extra stages as compared with the VLD, 
IDGT and DPGM processing stages, as shown in Rg. 6. 
When the input synchronizing signal is supplied through 
the signal line A103 and the data are successively sup- 
plied through the input bus A101 as shown In Fig. 6, 
therefore, inverse-quantized data are outputted after a 
lapse of 128 cycles. The input data supplied to the 
inverse quantizer 1214 are provided by the variable 
length decoder 1212 shown in Fig. 33. Before all output 
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data appearing at the output bus A1 02 from the inverse 
quantizer 1214 are outputted, or before the same are 
supplied to an inverse DCT device through the scan 
converter as shown in Rg. 28, the input data are ended 

5 in advance of at least 128 cycles. During this period, 
therefore, the variable length decoder can be utilized for 
header analysis. Thus, the processing following the 
inverse quantizer and the header analysis can be exe- 
cuted in parallel with each other (see Fig. 28), 

10 [0087] Rg. 7 illustrates another pipeline mode for 
the picture decoding circuit. In the picture decoding cir- 
cuit shown in Fig. 7, pipeline processing is executed by 
a pipeline of four stages in synchronization with the MB 
synchronizing signal MBSYNC. Referring to Fig. 7, the 

15 first stage pipeline reads a predictive picture from the 
DRAM, variable-length decodes the DOT coefficients 
(formation of fixed length DCT coefficient data), and 
carries out inverse quantization processing. In the read- 
ing of the predictive picture data from the DRAM, motion 

20 vectors are extracted from header information analyzed 
in a precedent processing section, so that the predictive 
picture data are read from the DRAM in accordance 
with the extracted motion vectors. 
[0088] The second pipeline stage carries out filter 

25 processing of the predictive picture data read from the 
DRAM. In the filter processing of the predictive pictures, 
a plurality of predictive pictures in the case of fractional 
prediction accuracy are synthesized (averaged) by 
interpolation. In the case of B pictures of interpolation 

30 prediction, picture data of two pictures which are prece- 
dent and subsequent in time are synthesized with each 
other (the picture data are synthesized with weighting 
according to respective time distances). Thus, the pre- 
dtotive picture data are formed. 

35 [0089] The third pipeline stage carries out inverse 
discrete cosine transformation processing (I DCT) and 
predictive difference code decoding processing (DPCM 
decoding). In the IDCT processing, inverse discrete 
cosine transformation processing of DCT coefficient 

40 data subjected to inverse quantization processing (IQ) 
is executed. In the DPCM decoding process, predictive 
differential encoding (addition) of pixel data formed by 
the IDCT processing and predictive picture data formed 
by predictive picture filter processing is carried out, to 

45 form original pixel data. When the macro blocks are i 
pictures, the IDCT processed data correspond to the 
original pixel data (when no DC prediction is made). The 
DPCM decoded and restored pixel data are written in 
the buffer which is included in the picture decoding cir- 

50 cuit. 

[0090] The fourth pipeline stage writes the decoded 
picture data in the DRAM. Namely, writing into the 
DRAM is carried out from the buffer. 
[0091] It is possible to remarkably reduce the time 
55 period of the processing unit by carrying out the 
processing of the picture decoding circuit, following the 
header analysis in a pipeline manner in units of seg- 
ments (macro blocks). Assuming that the MB synch ro- 
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nizing signal MBSYNC is asserted at an Interval of one 
processing section in Fig. 7, and therefore four process- 
ing sections are required for decoding block data of one 
macro block. Analysis of the header information is exe- 
cuted In each processing section. Fig. 7 shows an oper- 5 
ation sequence in the case of processing a digital NTSC 
signal (720 valid pixels/line, 480 lines/frame) In units of 
macro blocks each consisting of 1 6 by 1 6 pixels every 
frame, for example. First to 1350-th macro blocks MB#1 
to MB#1350 are processed by the four stage pipelines 10 
In the units of segments (one segment (macro block) Is 
processed in one processing section). 
[0092] Fig. 7 also shows access to the DRAM port 
in the case of carrying out the internal arithmetic 
processing operation in the picture decoding circuit in a is 
pipeline manner. In correspondence to the pipeline 
stages in the picture decoding circuit. 
[0093] As shown in Fig. 7, processing of the seg- 
ments which are the units of picture expansion process- 
ing can be executed in a pipeline manner over a plurality 20 
of processing sections due to the pipelined processing 
of the respective operational processors of the picture 
decoding circuit in units of segments, whereby the time 
required for all processing of one segment (time for one 
processing unit) can be effectively reduced. As shown In 25 
Fig. 7. one segment is processed in a processing sec- 
tion of a time of about 1/4 one processing unit, in the 
case of the four stage pipeline structure. 
[0094] The time period of the processing section 
shown in Fig. 7 may be fixed to a constant clock cycle 30 
number. However, it is also possible to change the time 
period (clock cycle number) of the processing section In 
accordance with the attributes of the segment. 
[0095] Fig. 8 illustrates an operation flow for chang- 
ing the time period of the processing section. With refer- 35 
ence to Fig. 8, a method for changing the clock cycle 
number of the processing section is now described. 
[0096] First, the MB synchronizing signal IVIBSYNC 
is asserted (step S1). In response to this assertion of 
the f\AB synchronizing signal MBSYNC, a timer included 40 
in the control circuit 1226 (see Fig. 33) Is started of 
counting (step S2). 

[0097] After the timer operation is started, a deter- 
mination is made as to whether or not it is necessary to 
change a set time on the basis of the header information 45 
analyzed in the precedent processing section (step S3). 
When the processing method for the macro blocks is 
complicated (in the case of B pictures subjected to bidi- 
rectional predictive encoding with motion prediction In 
fractional accuracy, for example), the processing unit so 
time period is increased. In this case, the set time is 
increased in accordance with the analyzed header infor- 
mation. When a determination is made that the change 
of the set time is necessary at the step S3, the time of 
the processing section is set at a proper value (long or 55 
short) in accordance with the analyzed header informa- 
tion. When a determination is made that the set time 
needs not be changed at the step S3, on the other hand, 



set time change processing at a step S4 is skipped. 
Then, a determination is made as to whether or not the 
count time of the timer reaches the set time (step S5). If 
the set time elapses, the process returns to the step SI , 
so that the MB synchronizing signal MBSYNC indicating 
starting of the next processing section is asserted. The 
step 85 is repetitively executed up to a lapse of the set 
time. 

[0098] The steps S3 and 34 may be carried out in 
parallel with the step SI. As to the change of the set 
time, if the timer is formed by a counter and a stored ref- 
erence value of a register and the count of the counter 
is compared by a comparator detecting matching/mis- 
matching therebetween and the MB synchronizing sig- 
nal MBSYNC is asserted in accordance with the result 
of comparison of the comparator, the reference value of 
the register is changed. When a counter of a variable 
stage number is employed and the stage number of the 
counter is changed upon changing of the set time, a 
count-up signal of the counter can be utilized as the MB 
synchronizing signal MBSYNC. 

[0099] When the time period of the processing sec- 
tion is constant, the steps S3 and S4 are omitted. 
[0100] Fig. 9 illustrates another technique of setting 
the time period of the processing section. The control 
operation shown in Fig. 9 is also executed in the control 
circuit 1226 shown in Fig. 32. The structure of the con- 
trol circuit 1226 is described later in detail. 
[0101] The processing section is started and the 
MB synchronizing signal MBSYNC is asserted (step 
S10). Then, steps SI 2, SI 4 and S16 are executed in a 
parallel mode. At the step SI 2, a determination is made 
as to whether or not loading of the bit stream from the 
rate buffer Into the variable length decoder is com- 
pleted. At the step SI 4, a determination is made as to 
whether or not a prescribed set time elapses from the 
assertion of the MB synchronizing signal MBSYNC. At 
the step SI 6, a determination is made as to whether or 
not analysis of header infomnation is entirely completed. 
A signal indicating whether or not the analysis of the 
header information is entirely completed is outputted 
from the variable length decoder, as described later in 
detail. The results of these determinations are moni- 
tored at a step 81 8, so that the process returns from the 
step 81 8 to the step 81 0 if all results of the determina- 
tion at the steps 812, 814 and SIS are affirmative 
(YES), and the MB synchronizing signal MBSYNC des- 
ignating starting of the next processing section is 
asserted. 

[0102] it is possible to reliably start the next 
processing section after necessary processing is com- 
pleted by executing the processing operation shown in 
Fig. 9. It is possible to prevent the next section from 
being started in an intennediate stage of the data 
processing (during the data read operation from the rate 
buffer or the header analysis operation, for example). As 
compared with a structure of fixedly setting the time 
period of the processing section, therefore, the series of 
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processing from the variable length decoding operation 
to the pixel restoration processing is reliably started in a 
pipeline mode after all necessary processing is com- 
pleted (after all necessary data are supplied). Referring 
to Fig. 9, the set time at the step S14 may be rendered 
changeable in accordance with the attributes of the seg- 
ments to be decoded (see Fig. 8). 
[0103] As hereinabove described, it is possible to 
remarkably reduce the segment processing sections in 
time by bringing the respective operational processors 
of the picture decoding circuit into a pipeline structure in 
the units of the segments. 

Error Processing Operation: 

[0104] The data of the bit stream inputted in the pic- 
ture decoding circuit may include error bits. In the bit 
stream subjected to variable length encoding, lengths of 
symbols are differentfrom each other. When an error bit 
is mixed, therefore, an error of one symbol exerts an 
influence on a following symbol and hence correct vari- 
able length decoding cannot be carried out Due to the 
mixed error bit, the picture decoding circuit makes tran- 
sition from a steady, normal state of canning out correct 
decoding to an unsteady, abnomnal state incapable of 
carrying out correct decoding. The picture decoding cir- 
cuit must carry out return from such an abnomnal state 
to the normal state and processing of suppressing qual- 
ity deterioration of decoded pictures in the abnomnal 
state to the minimum. The processing which is carried 
out between error detection and return to the correct 
state is called error processing. Processing for reducing 
the influence by the error on the display screen which is 
carried out on the segments processed in the abnomnal 
state is called "error concealment processing". The 
error processing operation and the error concealment 
processing are now described. 

[0105] Rg. 10 is a flow chart schematically repre- 
senting an operation of the picture decoding circuit upon 
error detection. The operation of the picture decoding 
circuit in error detection is now described with reference 
to Fig. 10. 

[0106] Rrst, an error is detected at a step S20. In 
this error detection, a determination on occurrence of 
an error is made when a necessary symbol is not found 
in header analysis including a start code in the variable 
length decoder, or a corresponding symbol is not found 
in variable length decoding processing of the quantiza- 
tion index, for example, and an error detection signal is 
generated based on the result of comparison. 
[0107] When the en^or is detected, a start code hav- 
ing a particular pattern is searched (step S21). In the 
MPEG standard, the start code includes a slice start 
code, a picture start code, a GOP start code or a 
sequence start code for indicating starting of a layer, or 
a sequence error code. 

[0108] When the start code is detected through the 
search process, a determination is made as to whether 



or not the detected start code is effective for correct 
return (step S22). For example, a sequence error code 
which is a start code is not effective for the correct 
return (return to the steady state). Therefore, search tor 

5 another start code Is continued. 

[01 09] When a start code effective for correct return 
is detected, a header following this start code is ana- 
lyzed (step S23). At this time, header information 
included in the first segment following the start code is 

10 analyzed. Through this header analysis, the segment 
which must retum to the normal state (steady state) is 
identified. As shown in Fig. 11 , a header 1400 (including 
all headers up to a macro block header preceding 
macro blocks of the segment) stores resynchronization 

75 segment address information 1402 indicating the posi- 
tion on the display screen of the segment (macro block) 
at which return is made to the normal state in error gen- 
eration. In the MPEG standard, for example, the resyn- 
chronization segment address information 1402 

20 corresponds to a slice vertical position and macro block 
address increment included in the slice header. A resyn- 
chronization segment address is identified by analyzing 
the header 1400, whereby the segment which should 
return from the unsteady state to the steady state can 

25 be identified. 

[0110] When the valid start code is a sequence 
start code, a GOP start code or a picture start code in 
the MPEG standard, for example, the segment which 
should return to the steady state is the first segment of 

30 the picture. 

[0111] When the detected start code Is a slice start 
code, return to the steady state can be started from the 
first segment of the slice layer since the slice layer is 
provided for preventing error propagation. The header 

35 of the slice layer includes information indicating the 
position on the screen as described above, and the 
information indicating the position on the screen is uti- 
lized as the resynchronization address. 
[0112] After the header Information is analyzed, 

4o variable length decoding processing of the data of the 
macro block following the header is waited until pre- 
scribed conditions are established. 
[0113] Namely, a determination Is made as to 
whether or not the segment to be subsequently proc- 

45 essed in the picture decoding circuit corresponds to the 
macro block address obtained in the header analysis 
carried out at the step S23 (step S24). 
[0114] In the search for the start code, the bit 
stream which is supplied to the picture decoding circuit 

50 is employed for the start code search, and no decoding 
processing of macro block data included in the bit 
stream is carried out. On the other hand, the picture 
decoding circuit outputs picture data subjected to the 
error concealment processing which is described later 

55 in detail every processing section. For example, it is 
possible to recognize the address (position on the 
screen) of the segment processed in each processing 
section by counting the MB synchronizing signal 
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MBSYNC defining each processing section In the con- 
trol unit, for example. Therefore, it is possible to discrim- 
inate whether or not a segment to be processed in the 
next processing section corresponds to the macro block 
address obtained in the header analysis in the control 
unit. When the macro block address of the segment to 
be subsequently processed matches with the macro 
block address obtained by the header analysis, return is 
made to the normal operation from the next processing 
section under control by the control unit (step S25). 
[0115] Also in the return from the unsteady state to 
the steady state, the header information Is analyzed in 
advance and the decoding processing of the block data 
is started in accordance with the MB synchronizing sig- 
nal MBSYNC, whereby no reduction of the utilization 
efficiency is brought in the respective operational proc- 
essors of the picture decoding circuit. 
[0116] In the error development, reading of the pre- 
dictive picture data in each processing section may be 
stopped so that this period is utilized for data reading 
from the rate buffer. This is because the pixel data of the 
macro block can be replaced by average value data of 
pixel data of a macro block in a same common picture in 
error development, as described later in detail. Thus, it 
Is possible to search for the necessary start code at a 
high speed. 

[0117] Fig. 12 schematically illustrates the structure 
of a part related to the processing operation of error 
detection and the retum in the picture decoding circuit. 
This figure shows only the variable length decoder 1212 
and the control unit 1226. The variable length decoder 
and the control unit are denoted by the same reference 
numerals as those of the variable length decoder and 
the control unit shown In Fig. 32. This is for Indicating 
that the functions of picture decoding processing itself 
are identical between the inventive and conventional 
units, but the structures are different from the conven- 
tional components as described above. 
[0118] The control unit 1226 supplies a start signal 
<t>ACT for starting picture decoding processing and the 
MB synchronizing signal MBSYNC to the variable 
length decoder 1212. The variable length decoder 1212 
outputs to the control unit 1226 an error detection signal 
<|)ER, a valid start code (start code effective for return to 
the normal operation) detection indication signal ^SD 
and a processing unit decoding completion indication 
signal <t)CPL indicating that the infom^ation of the 
header of the segment is entirely analyzed. The opera- 
tion of the structure shown in Fig. 12 is now briefly 
described with reference to Fig. 13 which is an opera- 
tion sequence diagram thereof. 

[0119] The control unit 1226 asserts the MB syn- 
chronizing signal MBSYNC onto the variable length 
decoder 1212. The variable length decoder 1212 
decodes the block data in synchronization with the 
assertion of the MB synchronizing signal MBSYNC, and 
outputs fixed length DCT coefficient data. After comple- 
tion of the decoding of the block data, information of the 



header of the next segment is analyzed. When analysis 
of the header Information is entirely completed, the var- 
iable length decoder 1212 asserts the processing unit 
decoding completion indication signal ^CPL onto the 

5 control unit 1226. When the processing unit decoding 
completion indication signal ^CPL is asserted, the con- 
trol unit 1226 asserts the MB synchronizing signal 
MBSYNC again onto the variable length decoder 1212 
after prescribed conditions are satisfied. In response to 

10 this, decoding processing of the block data is executed. 
When an error Is detected in the decoding procedure, 
the variable length decoder 1212 asserts the error 
detection indication signal <|)ER. In response to the 
assertion of the error detection indication signal <t)ER, 

15 the control unit 1226 enters an error state. In this en'or 
state, error concealment processing described later is 
executed. The variable length decoder 1212 searches 
for a start code in response to the assertion of the error 
detection Indication signal (t)ER. When a valid start code 

20 is detected, the variable length decoder 1212 asserts 
the start code detection indication signal ^SO. When the 
start code is detected, the variable length decoder 1212 
analyzes the information of the header part of the seg- 
ment following the start code, and asserts the process- 
es ing unit decoding completion indication signal ^CPL at 
the point of time when the analysis is completed, onto 
the control unit 1226. The control unit 1226 determines 
whether or not the segment to be executed in the next 
processing section is that whose header Information is 

30 analyzed in accordance with the analyzed header infor- 
mation and the start code information, and asserts the 
MB synchronizing signal MBSYNC in response to the 
assertion of the processing unit decoding completion 
Indication signal ^CPL If the segment is to be executed 

35 in the next processing section. In the sequence shown 
In Fig, 13, therefore, the process returns to the steady 
state (normal state) from the processing section follow- 
ing that causing the error. 

[0120] Fig. 14 Illustrates another operation 

40 sequence of the picture decoding circuit in error detec- 
tion. Referring to Fig. 14, an operation sequence identi- 
cal to that shown in Fig. 13 is executed after the error 
detection indication signal (|>ER is asserted In error 
detection until the processing unit decoding completion 

45 indication signal ^OPL Is asserted. 

[0121] Upon assertion of the processing unit 
decoding completion indication signal <|)C PL, the control 
unit 1226 determines a time when the segment of the 
analyzed header must be processed from the analyzed 

50 header information (detection of the macro block 
address). When the analyzed segment is not to be exe- 
cuted in the next processing section, the control unit 
1226 asserts the MB synchronizing signal MBSYNC on 
conditions of assertion of the processing unit decoding 

55 completion indication signal <^CPL, a lapse of a pre- 
scribed time (see Fig. 9) from the precedent MB syn- 
chronizing signal MBSYNC and vacancy (nonuse) of 
the DRAM port. In the error time, the processing of the 
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block data of the analyzed segment is brought into a 
standby state. Until the processing section for the seg- 
ment which is analyzed and brought into the standby 
state is reached, the MB synchronizing signal MBSYNC 
is asserted every lapse of the prescribed time on the 
condition of vacancy of the DRAM port. The vacancy of 
the DRAM port is made one of conditions in the error 
state since it is necessary to write decoded data from 
the picture decoding circuit in the DRAM port. In this 
error state, the processing unit decoding completion 
indication signal <^CPL may be maintained in an 
asserted state. Namely, the processing unit decoding 
completion indication signal ^CPL may be reset by 
assertion of the MB synchronizing signal MBSYNC 
when the blocl< data are to be processed in the next 
processing section. 

[0122] When the processing section for processing 
the segment in the standby state is reached, the picture 
decoding circuit enters the normal state in accordance 
with assertion of the MB synchronizing signal MBSYNC, 
to decode the block data of the segment in the standby 
state. 

[0123] When a processing section for an actual 
decoding is detected from the resynchronization seg- 
ment address obtained at the time of the header analy- 
sis In the error state for return to the normal state, the 
following method can be employed: A counter which is 
reset in synchronization with a picture synchronizing 
signal (e.g., a vertical synchronizing signal VSYNC) 
indicating starting of a picture is employed to count the 
MB synchronizing signal MBSYNC, and the macro 
block address (position on the screen) of each process- 
ing section is monitored in accordance with the count 
value. When an address subsequent to the monitored 
macro block address is equal to the resynchronization 
address, the block data of the segment at the standby 
state must be processed in the next processing section. 
Since the header information is entirely analyzed before 
assertion of the MB synchronizing signal MBSYNC, this 
determination processing can be reliably carried out in a 
processing section which is precedent to that for actu- 
ally executing the decoding processing. 
[0124] Also in such error development, the header 
infomriation is entirely analyzed and the subsequent 
processing is brought into a standiDy state and process- 
ing of the standby state block data is executed in syn- 
chronization with the MB synchronizing signal MBSYNC 
when the processing must be carried out. The block 
data to be processed are immediately supplied to the 
variable length decoder 1212 in synchronization with 
the MB synchronizing signal MBSYNC also in return 
from the error state to the normal state, and hence the 
processing can be executed at a high speed. In the 
operation sequence shown in Fig. 14, no block data are 
newly supplied to the picture decoding circuit during the 
period of the error state. The error concealment 
processing described later in detail is executed in this 
processing section. 
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[0125] Fig. 15 specifically illustrates the internal 
structure of the variable length decoder 1212 shown in 
Fig. 12. Referring to Fig. 15, the variable length decoder 
1212 includes a bit stream feeder 1 receiving the bit 

5 stream which is read from the rate buffer through a 
buffer memory (not shown) and supplying bit stream 
data from the head (first) bit of a variable length symbol, 
a start code detector 2 receiving the data from the bit 
stream feeder 1 and detecting the start code, a header 

10 analysis part 3 receiving the bit stream data from the bit 
stream feeder 1 and analyzing the header information, a 
block data decoder 4 decoding the block data included 
in the bit stream data from the bit stream feeder 1 and 
. generating fixed length quantized DCT coefficient data, 

75 an error detection part 5 detecting occurrence of an 
en-or in response to an error detection signal from the 
start code detection part 2, the header analysis part 3 
and the block data decoder 4. and a control part 6 con- 
trolling the operation of the variable length decoder 

20 1212. 

[0126] The control part 6 receives a start request 
signal <|»ACT (this signal is described later in relation to 
an operation in resetting) and the MB synchronizing sig- 
nal MBSYNC, and outputs an error detection indication 

25 signal <|>ER, a processing unit decoding completion indi- 
cation signal (|>CPL and a start code detection indication 
signal <fSD. This control part 6 receives a detected start 
code from the start code detection part 2, and asserts 
the start code detection indication signal ^SD when the 

30 start code is effective for return to the steady state. The 
control part 6 also receives a header information analy- 
sis completion indication signal (detected by end bit 
detection of the header) from the header analysis part 3 
and asserts the processing unit decoding completion 

35 indication signal (j)CPL. The control part 6 asserts the 
error detection indication signal (j)ER in response to the 
error detection signal from the error detection part 5. 
[0127] The control part 6 further receives the start 
code from the start code detection part 2, information 

40 indicating a bit lengths of analyzed variable length code 
from the header analysis part 3, and bit length informa- 
tion of a decoded variable length code from the block 
data decoder 4, deletes the processed (detected, ana- 
lyzed or decoded) variable length code in the bit stream 

45 feeder 1, detects a next head bit of a variable length 
code and supplies the next variable length code from 
the head (first) bit to the header analysis part 3 or the 
block data decoder 4 from the feeder 1. The bit stream 
feeder 1 regularly outputs data bits successively from 

so the most significant bit of a variable length code under 
the control of control part 6. The start code detector 2 
constantly monitors the bit data from the bit stream 
feeder 1, to detect whether or not the start code is 
included. 

55 [01 28] The header analysis part 3 analyzes variable 
length code words (header information) supplied from 
the bit stream feeder 1 immediately subsequently to the 
completion of the decoding operation of the block data 
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decoder 4 under control by the control part 6 (this con- 
trol path is not shown). The block data decoder 4 Is acti- 
vated in synchronization with the MB synchronizing 
signal MBSYNC under control by the control part 6, and 
decodes the variable length codes supplied from the bit 
stream feeder 1 . 

[0129] The header analysis part 3 extracts informa- 
tion such as motion vectors, a processing method (pre- 
diction method) for the macro blocks and the like as well 
as return (resynchronization) segment address informa- 
tion in error generation for supplying to the control unit. 
The block data decoder 4 outputs a fixed length quanti- 
zation index to the next stage inverse quantizer. 
[0130] The header analysis part 3 is described as 
constantly analyzing variable length codes. However, 
the sequence header, the GOP header and the picture 
header are fixed length data, which are subjected to 
fixed length decoding. Whether the header analysis part 
3 carries out analysis of fixed length codes or analysis 
of variable length codes is decided by the control part 6 
in accordance with the start code detected in the start 
code detection part 2. The control part 6 instructs the 
header analysis part 3 about which analysis operation 
should be carried out in accordance with the detected 
start code. Alternatively, such a structure that the 
header analysis part 3 itself determines which operation 
is carried out along a syntax may be employed. Further, 
the start code detection part 2 is described as con- 
stantly searching for the start code. However, the start 
code detector 2 may alternatively be so structured that 
its detecting operation is stopped in operations of the 
header analysis part 3 and the block data decoder 4. 
[0131] Fig. 16 specifically illustrates the internal 
structure of the control unit 1226 shown In Fig. 12. 
Referring to Fig. 16, the control unit 1226 includes an 
initialization control circuit 14 outputting a start indica- 
tion signal <j)ACT for the variable length decoder in 
response to a reset request indication signal <^RRQ, a 
state monitor 15 monitoring the progress state of the 
processing of the variable length decoder in accordance 
with the error detection indication signal ^ER and the 
start code detection indication signal <j)SD from the vari- 
able length decoder, and an operation driving circuit 1 1 
receiving the starting indication signal <|)ACT from the 
initialization control circuit 14, the output signal from the 
state monitor 15, a picture synchronizing signal PSYNC 
indicating starting of a picture, a processing unit decod- 
ing completion indication signal <t)CPL supplied from the 
variable length decoder and header information (block 
specifying information) and supplying the MB synchro- 
nizing signal MBSYNC to respective pipeline stages of 
computing units of the decoding circuit. 
[0132] The initialization control circuit 14 asserts 
the starting indication signal <^ACT for supplying to the 
variable length decoder when the reset request signal 
(|)RRQ requesting resetting of a decoding operation of 
picture data is asserted. This reset request signal <j)RRQ 
may be a decoding processing start indication signal for 
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instructing the starting of decoding the picture data, or a 
reset request indication signal resulting from Interrup- 
tion of an external control unit. Further, the reset 
request signal <1>RRQ may be generated when an en-or 
5 state is caused in continuation for a prescribed time 
duration or the error detection indication signal is suc- 
cessively asserted by a prescribed number of times in a 
prescribed time. 

[0133] The state monitor 15 informs the operation 
10 driving circuit 1 1 of the fact that an error occurs in the 
decoding process of the variable length decoder in 
response to assertion of the error detection indication 
signal (j)ER, and of the fact that the variable length 
decoder enters a preparation stage for return to the nor- 
75 mal state upon assertion of the start code detection 
indication signal ^SD. 

[0134] The operation driving circuit 11 starts clock- 
ing of a timer 16 upon assertion of the MB synchroniz- 
ing signal MBSYNC. The timer 16 carries out its 

20 counting operation, and supplies a time-out signal to the 
operation driving circuit 1 1 upon reaching a set time. 
This timer 16 may be so structured that the operation 
driving circuit 1 1 changes the set time in accordance 
with block attribute information (header information) 

25 supplied from the variable length decoder (see Fig. 8). 
In a normal state, the operation driving circuit 1 1 asserts 
the MB synchronizing signal MBSYNC when the 
processing unit decoding completion indication signal 
<^CPL Is asserted, the time-out signal from the timer 1 6 

30 is asserted and a signal indicating a vacant state (read- 
ing from the rate buffer Is completed) of a DRAM port Is 
received from a bus access controller 1 2. 
[0135] Upon error generation, the operation driving 
circuit 11 can-les out the following operation in accord- 

35 ance with a signal outputted from the state monitor 15: 
The operation driving circuit 1 1 includes a counter (not 
shown) which is reset in response to the picture syn- 
chronizing signal PSNC and counts up every assertion 
of the MB synchronizing signal MBSYNC. The count 

40 value of this counter indicates the position on the screen 
(macro block address) of the segment processed in the 
variable length decoder. When it is informed from the 
state monitor 1 5 of the fact that a start code effective for 
normal return is detected in accordance with the start 

45 code detection indication signal (|»SD, the operation driv- 
ing circuit 1 1 extracts a resynchronization address from 
the block attribute information which is supplied follow- 
ing the start code detection indication signal <|)SD. It 
compares the resynchronization address with the count 

50 value of the counter, and determines whether or not it is 
possible to return to the normal state from the next 
processing section. If it is possible to return to the nor- 
mal state at the next processing section, the operation 
driving circuit 1 1 asserts the MB synchronizing signal 

55 MBSYNC in response to assertion of the processing 
unit decoding completion indication signal ^CPL which 
is supplied following the start code detection indication 
signal (jiSD, time out indication of the timer 1 6 and a rate 
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buffer reading completion (DRAM port empty) indication 
signal from the bus access controller 12. The respective 
operational processors following the variable length 
decoder (block data decoder of Rg. 15) operate in 
response to the MB synchronizing signal MBSYNC. 5 
[0136] When the next processing section is not yet 
that in which return to the normal state should be made, 
on the other hand, the operation driving circuit 1 1 out- 
puts the MB synchronizing signal MBSYNC in accord- 
ance with the time-out signal outputted from the timer 10 
16 and the signal of the bus access controller 12 indicat- 
ing nonuse of the DRAM port. In this en'or state (the 
state where the next processing section is not that in 
which return to the normal state should be made), the 
MB synchronizing signal MBSYNC may be supplied to is 
the pipeline stages of the respective operational proces- 
sors excluding the variable length decoder. Alterna- 
tively, the MB synchronizing signal MBSYNC may be 
supplied to the respective operational processors of the 
pipeline stages Including the variable length decoder 20 
(block data decoder) while a normal return inhibition sig- 
nal is asserted from the operation driving circuit 1 1 to be 
supplied to the variable length decoder simultaneously 
at this time so that a variable length decoding operation 
by the variable length decoder can be inhibited. Also in 25 
the error state, the picture decoding circuit outputs pic- 
ture data (the error concealment processing described 
later is carried out). 

[0137] When a segment in a standby state is to be 
executed In the next processing section, the operation 30 
driving circuit 1 1 asserts the MB synchronizing signal 
MBSYNC in accordance with the time-out signal output- 
ted from the timer 1 6 and the signal indicating the empty 
state of the DRAM port outputted by the bus access 
controller 12. Thus, the operation driving circuit 11 35 
returns to the normal state, and stops the operation of 
comparing the count value of the counter with the resyn- 
chronization segment address. In this normal state, the 
operational processors following the variable length 
decoder (block data decoder) operate in accordance 40 
with the MB synchronizing signal MBSYNC from the 
operation driving circuit 11, to execute prescribed nor- 
mal processing respectively. 

[0138] The bus access controller 12 controls an 
access operation to the DRAM port under control by the 45 
operation driving circuit 11. Namely, it executes port 
control of the FIFO interface 1210 and the memory 
Interface 1224 shown in Rg. 32 successively in a pre- 
scribed order. Namely, the bus access controller 12 first 
writes completely decoded picture data from the pixel so 
reconfigurator 1220 in the external memory (DRAM) 
1230 through the memory interface 1224 In synchroni- 
zation with the MB synchronizing signal MBSYNC from 
the operation driving circuit 11 (in a normal operation). 
[0139] After completion of this write operation, the ss 
bus access controller 12 executes writing of the bit 
stream from the FIFO interface 1210 in the external 
memory (DRAM) through the memory interface 1224 
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(writing in the rate buffer), reading of display picture 
data from the external memory (DRAM) 1230 in the 
pixel bus interface 1222 through the memory interface 
1224, transfer of predictive picture data from the exter- 
nal memory (DRAM) 1230 through the memory inter- 
face 1224, and transfer of data from the external 
memory (DRAM) 1230 into the variable length decoder 
through the FIFO interface 1210 and the memory inter- 
face 1224 (transfer to a buffer memory (not shown)) 
(reading of the rate buffer). During this time, the bus 
access controller 12 executes refreshing of the external 
memory (DRAM) 1230 at prescribed intervals, and 
inhibits access to the external memory during this 
refreshing. In the error state, the bus access controller 
12 may utilize the period of reading predictive picture 
data as a period of reading data from the rate buffer in 
response to the error state indication signal from the 
operation driving circuit 11. Further, a completion time 
of reading the predictive picture data may be decided in 
accordance with the block attribute information from the 
operation driving circuit 11. 

[0140] An error concealment control circuit 13 con- 
trols the error concealment processing described later 
in detail. This error concealment control circuit 13 is 
started in response to the en-or detection indication sig- 
nal 0ER from the state monitor 15 to instruct the error 
concealment processing (signal i^ERR) to the scan con- 
version part or to the pixel reconfigurator and the scan 
conversion part, and instructs completion of this error 
concealment processing in response to a normal state 
return indication from the operation driving circuit 1 1 . 
[0141] According to the embodiment of the present 
invention, as hereinabove described, the start code 
which Is effective for return from the error state to the 
steady (nonnal) state Is detected in error generation, 
then analysis of the header information of the segment 
is executed and processing of the block data of the seg- 
ment is delayed up to arrival of the processing section 
for actual processing, whereby return to the normal 
state can be carried out also in error development with- 
out reducing the utilization efficiency of the operational 
processors. 

Error Concealment Processing 1 : 

[01 42] Fig. 1 7 schematically illustrates the structure 
of the pixel reconfigurator 1220 of the picture decoding 
circuit according to the present invention. Refen-ing to 
Fig. 17, the pixel reconfigurator 1220 includes a buffer 
memory 20 temporarily storing data supplied through 
the memory interface 1224, a predictive picture filter 
part 21 forming predicth/e pictures through the picture 
data stored In the buffer memory 20, a computing ele- 
ment 22 Illustrated as an adder for adding up data from 
the inverse discrete cosine transformation part (IDCT) 
1 21 8 and an output signal from the predictive picture fil- 
ter part 21 and carrying out DPCM decoding, a selec- 
tion circuit 23 selecting one of the data outputted from 
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the IDCT 1218, data outputted from the computing ele- 
ment 22 and the pixel data from the predictive picture fil- 
ter part 21 , and a buffer memory 24 temporarily storing 
output data of the selection circuit 23. The storage data 
of the buffer memory 24 are stored in the external mem- 5 
ory (DRAM) as decoded pixel data through the memory 
interface 1224. Macro block types of B pictures include 
(1) intra-frame/intra-field prediction employing neither 
one of forward prediction and reverse (backward) pre- 
diction, (2) forward prediction in which prediction is 70 
made based on past reproduced pictures, (3) reverse 
prediction in which prediction is made based on the 
future pictures, and (4) interpolation prediction employ- 
ing both of past and future pictures. 

[0143] The predictive picture filter part 21 carries is 
out prescribed processing in accordance with the macro 
block type, and fomris predictive pictures. The pixel 
reconfigurator 1 220 further includes a control part 25 for 
controlling the operation of pixel reconfiguration. The 
control part 25 receives header information supplied 20 
from the variable length decoding part, the MB synchro- 
nizing signal MBSYNC and the error detection indica- 
tion signal (|)ERR from the control unit (see Fig. 1 6), and 
a bus employment allowing signal from the control unit 
(bus access controller). The control part 25 decides fil- 25 
ter processing which is executed in the predictive pic- 
ture filter part 21 in accordance with the macro block 
type included in the header information. Further, the 
control part 25 controls data writing and data reading in 
and from the buffer memories 20 and 24 in synchroniza- 30 
tion with the MB synchronizing signal MBSYNC. 
[0144] As to picture data which are loaded in the 
buffer memory 20 through the memory interface 1224, 
addresses are generated In accordance with motion 
vector information formed through the result of analysis 35 
of the header analysis part in the variable length 
decoder and necessary picture data (reference seg- 
ment data) is read from the external memory (DRAM). 
In error development, the motion vector information is 
formed on the basis of transmitted motion vector infer- 40 
mation. As described later, this motion vector may be 
set at zero in the case of an error generation. Alterna- 
tively, motion vector indicating a macro block which is 
precedent by one line may be employed in the case of 
an error generation. Namely, macro block data of a cor- 45 
responding portion in the predictive picture(s) are read 
in error generation. 

[0145] Under control by the control part 25, the 
selection circuit 23 selects the data from the IDCT 1218 
when the processed macro block is an intra-predicted so 
macro block (I pictures and intra-predicted B pictures), 
selects the data outputted from the computing element 
22 with respect to a prediction encoded macro block 
other than intra prediction, and selects the output data 
from the predictive picture filter part 21 in error process- ss 
ing. An error countermeasure operation in the case of 
employing the pixel reconfigurator shown in Fig. 17 is 
now described. 



[0146] Fig. 18 is an operation sequence diagram 
representing the error countermeasure operation of the 
picture decoding circuit in error processing. As shown in 
Fig. 18, the picture decoding circuit is formed into four 
pipeline stages in units of segments (macro blocks), 
similarly to the aforementioned embodiment. Consider 
that an error occurs in a decoding process for block data 
of a segment MB#1 1 . The error detection indication sig- 
nal (|)ER ((|)ERR) is asserted in this state, while the vari- 
able length decoder and the control unit execute the 
aforementioned operations upon generation of an error. 
In the processing section during which this error occurs, 
the pixel reconfigurator 1220 shown in Fig. 17 carries 
out a pixel decoding operation so that restored pixel 
data are stored in the buffer memory 24. When a next 
processing section is started, predictive picture data for 
error concealment of a part corresponding to a macro 
block MB#12 are stored in the buffer memory 22 
through the memory interface 1224. The predictive pic- 
ture fitter part 21 forms predictive picture data for the 
macro block MB#1 1 . On the other hand, the IDCT 1218 
forms inverse-quantized data of block data of a macro 
block MB#1 0, so that pixel-restored data are formed in 
accordance with the macro block type thereof through 
the selection circuit 23 and successively written in the 
buffer memory 24. In the buffer memory 24, on the other 
hand, previously stored decoded pixel data of a macro 
block MB#9 are written in the DRAM through the mem- 
ory interface 1224. In the buffer memories 20 and 24, 
new data are written after storage data thereof are 
entirely read out. 

[0147] Thereafter pipeline processing is succes- 
sively executed so that data of corresponding macro 
blocks of the predtotive pictures are successively read 
from the external memory (DRAM) and picture data are 
generated in this error state (slanted areas in Fig. 18). 
[0148] Predictive picture pixel data read in the 
processing section for the macro block MB#12 are 
selected by the selection circuit 23. Thus, correspond- 
ing pixel data of the predictive pictures are successively 
stored in the buffer memory 24. The predictive picture 
filter part 21 carries out filter processing in accordance 
with a predetermined rule in error detection. 
[0149] Therefore, pixel data subjected to error 
countermeasures, i.e., pixel data of predictive pictures, 
are successively stored in the DRAM from a processing 
section for processing a macro block MB#1 5. 
[0150] When the error state is ended in a process- 
ing section for a macro block MB#16, processing of a 
macro block MB#1 7 is executed from the next process- 
ing section. In this case, the selector 23 selects either 
data outputted from the IDCT 1218 or data outputted 
from the computing element 22 in accordance with 
header information when the processing of the block 
data of the macro block MB#17 reaches the third pipe- 
line stage. 

[0151] Due to the aforementioned series of opera- 
tions, pixel data which are rinissed by an error can be 
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replaced by pixel data of predictive pictures in an error 
state, thereby suppressing picture quality deterioration 
of decoded picture images caused by mixing of an error 
bit (see Fig. 1 9). Namely, it is possible to suppress dete- 
rioration in quality of decoded images in the macro 
blocks MB#12 to MB#16 in the error state, as shown in 
Fig. 19. 

Error Concealment Processing 2: 

[0152] Rg. 20 illustrates the structure of a pixel 
reconfigurator 1220 for implementing second error con- 
cealment processing according to the present invention. 
In the structure of the pixel reconfigurator shown in Fig. 
20, a control part 35 sets a selection circuit 33 in a state 
selecting an output signal of an IDCT 121 8 in response 
to header information, an MB synchronizing signal 
MBSYNC, an output signal of a bus access controller 
and an error concealment control circuit included in the 
control unit of Fig. 6 when an error is generated. Other 
structures are identical to those shown in Fig. 17, and 
corresponding parts are denoted by the same reference 
numerals. In a normal state, the control part 35 makes a 
computing element 22 process (DPCM-decode) pixel 
data from a predictive picture filter part 21 and pixel data 
outputted from the IDCT 1 21 8, and thereafter selects an 
output signal from the IDCT 1218 or the computing ele- 
ment 22 through the selector 33 in accordance with the 
type of this picture for writing into a buffer memory 24. In 
an error state, i.e., in activation of a signal <|)ERR, the 
control part 35 controls the selection circuit 33 and sets 
the same in a state selecting the data outputted from the 
IDCT 1218 regardless of the pk^ture type. 
[0153] The IDCT 1218 is supplied with data output- 
ted from a scan conversion part 1216 whose structure is 
hereafter described in detail. As hereafter described in 
detail, in an error state, the scan conversion part 1216 
supplies the IDCT 1218 with decoded macro block data 
precedent by one line (data before IDCT processing) in 
the same picture or a predetermined fixed value (when 
no macro block precedent by one line is present) from a 
processing section following that having the error 
caused. 

[0154] Rg. 21 illustrates the internal structure of the 
scan conversion part 1216 shown in Fig. 20 in detail. 
Referring to Fig. 21, the scan conversion part 1216 
includes a buffer memory 40 successively storing 
inverse- quantized DCT coefficient data outputted from 
an inverse quantizer and then outputting the stored data 
in the raster scan order, a readAwrite control circuit 41 
controlling data writing and data reading of the buffer 
memory 40, an averaging circuit 42 obtaining the aver- 
age value of DCT coefficients read from the buffer mem- 
ory 40, a memory 43 storing average data of macro 
blocks by one line, for example, among average value 
data outputted from the averaging circuit 42 in a FIFO 
fashion, a readAvrite control circuit 44 controlling data 
writing and reading of the memory 43, and a selection 



circuit 45 selecting either DCT coefficient data outputted 
from the buffer memory 40 or data from the memory 43 
for outputting to the IDCT 1218 under control by the 
read/write control circuit 44, 

5 [0155] The read/write control circuit 41 stores in 
buffer memory 41 inverse quantized DCT coefficient 
data which are supplied from the inverse quantizer at 
the precedent stage in synchronization with the MB syn- 
chronizing signal MBSYNC. This read/write control cir- 

10 cult 41 simply has a function of converting read and 
write addresses for the buffer memory 40, and adjusts 
the addresses to re-arrange the DCT coefficients, which 
have been scanned in a zigzag scan fashion, into the 
raster scan order for outputting. The address generation 

75 may be so done that either read or write addresses are 
generated in a predetermined sequence while the other 
addresses are successively incremented so that zig- 
zag-scanned pixel data are re-arranged in the raster 
scan order. The zigzag scan converter 1216 may not be 

20 particularly included In a pipeline stage, since it func- 
tions as a buffer circuit by the buffer memory 40. There- 
fore, the readAwrrte control circuit 41 may be formed to 
generate addresses in synchronization with an input 
synchronizing signal indicating starting of the DCT coef- 

25 ficient data. 

[01 56] The averaging circuit 42 obtains the average 
value of the DCT coefficient data which are read from 
the buffer memory 40. At this time, the average value 
may be obtained by arithmetic mean values (all DC and 

30 AC coefficients) of all DCT coefficient data. In a block of 
8 by 8 pixels, however, a DC coefficient indicates the 
average value of pixel data of the block. Therefore, the 
averaging circuit 42 may obtain the average value of the 
DCT coefficient data of four blocks for a luminance slg- 

35 nal while utilizing the DC coefficient as the average 
value for a chrominance signal, with respect to one 
macro block. 

[01 57] The memory 43 stores average value data of 
DCT coefficients with respect to respective macro 

4o blocks for one line, for example, in the FIFO fashion. 
Operations of the scan conversion part and the pixel 
reconfigurator shown in Figs. 20 and 21 are now 
described with reference to Fig. 22, which is an opera- 
tion sequence diagram. 

45 [0158] Fig. 22 illustrates operations in the case 
where an error is caused in decoding of block data of a 
macro block MB#11 and return is made to a normal 
state from a macro block MB#17, for example. 
[0159] When an error detection indication signal 

50 ^ER is asserted, an error indication signal <>ERR from 
the error concealment control circuit is asserted in 
response (no (|)ERR is shown in Rg. 22). In response to 
the assertion of the error detection indication signal 
(|)ERR, the read/write control Circuit 44 shown in Fig. 21 

55 inhibits writing of average value data to the memory 43. 
Namely, storage of an average value data of DCT coef- 
ficient data calculated is inhibited in the case of error 
detection. Therefore, the memory 43 stores the average 
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value of DCT coefficients of one-line worthy macro 
blocks up to a macro block MB#9. No average value 
data of DCT coefficients of a macro block MB#10 is 
stored in the memory 43. Average value data of DCT 
coefficients of a macro block which is precedent to the 5 
macro block MB#1 0 just by one line is stored in a head 
address position of the memory 43. in a processing sec- 
tion having this error caused, pixel restoration process- 
ing for the macro block MB#9 is executed. Namely, the 
selection circuit 33 shown in Fig. 20 selects either an w 
output signal of the computing element 22 or data out- 
putted from the IDCT 1218 and supplies the selected 
one to the buffer memory 24, in accordance with an out- 
put signal from the control part 35. 

[0160] In a processing section subsequent to that 75 
having the error caused, the read/write control circuit 44 
shown in Fig. 21 reads average value data of DCT coef- 
ficients of a macro block, which is precedent by one line, 
stored in the head position from the memory 43 in 
response to the error indication signal (t>ERR, and sup- 20 
plies the read average data to the IDCT 1218 through 
the selection circuit 45. The memory 43 may store one 
average value data for luminance blocks of the macro 
block, or average value data for respective luminance 
signal blocks (since the IDCT 1218 executes inverse 25 
discrete cosine transformation processing in units of 8 
by 8 pixels). 

[0161] The selection circuit 33 shown in Fig. 20 is 
set in a state of selecting data outputted from the IDCT 
1218, under control by the control part 35. In the 30 
processing section subsequent to that having the error 
caused, therefore, pixel restoration (DPCM decoding) is 
executed in accordance with the pixel data of the macro 
block which is precedent by one line. As shown in Rg. 
22, therefore, the error concealment processing can be 35 
executed from the macro block which is ahead of that 
having the error caused while the error concealment 
processing can be executed also for the macro block 
causing the error, whereby picture quality deterioration 
caused by mixture of an error bit can be further sup- 4o 
pressed. Data of different macro blocks are succes- 
sively read from the memory 43 every processing 
section in synchronization with the MB synchronizing 
signal MBSYNC. 

[0162] When return is made from the error state to 45 
the normal state, the data from the memory 43 are 
selected and supplied to the IDCT 1218 in the process- 
ing section if the error indication signal <>ERR is deas- 
serted, average value data from the averaging circuit 42 
are written in the memory 43 in the next processing sec- so 
tion, and the selection circuit 45 is set in a state of 
selecting the output of the buffer memory 40 in a 
processing section subsequent to the next one. 
[0163] The memory 43 stores the data in the FIFO 
fashion, and hence the state of successively storing the ss 
pixel block data for one line is maintained also when the 
average value of block data of the macro block MB#17 
is newly written in the memory 43 in the FIFO fashion. 



[01 64] I n the return to the normal state, data may be 
written in the buffer memory 40 in synchronization with 
an input synchronizing signal indicating starting of block 
data supplied from the precedent stage inverse quan- 
tizer under control by the read/write control circuit 41. 
Alternatively, a normal state return indication signal may 
be supplied to the read/write control circuit 41 from the 
control unit so that the writing is performed from the 
processing section supplied with the normal state return 
indication signal (when the scan conversion part forms 
the final substages of the first pipeline stage including 
multiple substages (the first pipeline stage is up to data 
writing in the buffer 40)). Alternatively, the data may be 
written in the buffer memory 40 under control by the 
read/write control circuit 41 from a processing section 
subsequent to the processing section of return to the 
normal state (when the scan conversion part is included 
in the third pipeline stage). Alternatively, the scan con- 
version part 1216 may be arranged to form a part of the 
second pipeline stage. 

[0165] When the error is caused at the head of the 
picture, a predetermined fixed value is employed since 
no corresponding average value data is present. While 
this structure is not shown, either average value data or 
fixed value data may be selected in accordance with 
address (position on the screen) information of the proc- 
essed macro block, as shown in the dotted line in Fig. 
21. 

[01 66] Fig. 23 illustrates modes of the macro blocks 
which are subject to error-concealment process in the 
second error concealment processing shown in Figs. 20 
to 22. As shown In Fig. 23, the error concealment 
processing is executed through pixel data of a macro 
block which is ahead of the macro block MB#1 0, prece- 
dent to the macro block MB#1 1 having the error caused, 
by one line. Namely, the block data of the macro blocks 
MB#10 to MB#16 are replaced by pixel data of macro 
blocks MB#2 to MB#8 which are precedent by a single 
line in the same picture. 

[0167] In the above description, the error conceal- 
ment processing is carried out through the average 
value of the block data of the precedent macro blocks in 
error development A line memory storing pixel data of 
macro blocks for one line may be arranged in the pixel 
reconfigurator 1220 so that decoded pixel data of the 
macro blocks stored in this line memory are stored in 
the external memory (DRAM) through the buffer mem- 
ory 24 for replacing the respective pixel data with those 
of the macro block precedent by one line respectively in 
error development. 

[0168] According to the structure of the embodi- 
ment of the present invention, as hereinabove 
described, the error concealment processing can be 
efficiently executed by effectively utilizing the pipeline 
stages of the picture decoding circuit. Particularly when 
the error concealment processing is carried out through 
decoded data (variable length decoded data) in the 
same picture, the error concealment processing can be 
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executed from the macro block which is precedent in 
processing orxler to the segment (macro block) having 
the detected error, whereby further effective error con- 
cealment processing can be carried out and picture 
quality deterioration caused by mixing of an en'or bit can 5 
be suppressed. 

Initialization O peration 1 : Restarting (Return from Errpr) 

[0169] Fig. 24 is a flow chart showing an initializa- 10 
tion operation of the picture decoding circuit. The initial- 
ization operation of the picture decoding circuit 
according to the present invention is now described. 
[0170] Rrst, a determination is made as to whether 
or not a reset request is made (step S30). This reset is 
request is made in restarting when break of display by 
inten-uption through an external control unit or an error 
state continues over a prescribed time (when a state of 
returning from an error state to the normal state fol- 
lowed by re-return to the error state is continued). 20 
[0171] When a reset request (restart instruction) Is 
made, the control unit 1226 (see Fig. 16) first deter- 
mines whether or not this picture decoding circuit cur- 
rently carries out decoding of picture data (step S31). If 
decoding of the picture data is currently carried out 25 
(when a pixel restoration operation is carried out: includ- 
ing an operation in an error state), generation of the MB 
synchronizing signal MBSYNC from the next process- 
ing section is stopped (step S32). When generation of 
the MB synchronizing signal MBSYNC is stopped, the 30 
start signal ^ACT (R) is asserted and supplied to the 
variable length decoder (see Fig. 15). When no pixel 
restoration operation is carried out at the step S31 , on 
the other hand, the step S32 is skipped and the start 
signal <^ACT (R) is asserted at a step S33. 35 
[0172] The variable length decoder searches for a 
start code indicating starting of a picture in response to 
the assertion of the start signal <|)ACT (R). Namely, it 
searches for a sequence start code, a GOP start code 
or a picture start code. At this time, a slice start code is 40 
neglected because a new picture is searched. When a 
start code indicating starting of a picture is detected, 
infomnation of a header part following this start code is 
analyzed, and header information of a segment of a 
macro block layer is analyzed (step S34). Establishment 45 
of prescribed conditions is waited in the state of having 
analyzed the header information (step S35). The pre- 
scribed conditions are that a sufficient quantity of bit 
stream is stored in the rate buffer and a vertical synchro- 
nizing signal supplied from the external display control so 
unit is asserted. It is possible to discriminate whether or 
not a sufficient quantity of bit stream is stored in the rate 
buffer by detecting difference between write and read 
addresses of FIFO area of the external memory device 
(DRAM) through the bus access controller 12 shown in 55 
Fig. 16. 

[0173] When the prescribed conditions are estab- 
lished, the control unit asserts a picture synchronizing 



signal indicating the starting of the picture, resets a 
counter included in Its interior for indicating a macro 
block address, asserts the MB synchronizing signal in 
syncnronizaiion wiih the piclure t>yinjiiruMlz.liiy sigriSl, 
and makes the picture decoding circuit execute a nor- 
mal operation (step S36). Due to the assertion of the 
MB synchronizing signal MBSYNC in synchronization 
with the picture synchronizing signal PSYNC, display 
picture data can be correctly read in synchronization 
with a vertical synchronizing signal, for example, sup- 
plied from the external control unit when the reset 
request is made and a new picture is displayed. Further, 
pixel decoding operations can be successively executed 
in parallel with the picture display. 
[0174] The series of operations through the steps 
S30 to S33 are executed by the initialization control cir- 
cuit 14 shown in Fig. 16. 

Initialization Operation 2: Reset Operation 

[0175] Fig. 25 is a flow chart showing another initial- 
ization operation of the picture decoding circuit. This ini- 
tialization operation of the picture decoding circuit 
according to the present invention is now described. In 
this initialization operation, the user newly designates 
picture display. 

[0176] First, a determination is made as to whether 
or not a reset request (initialization instruction) is made 
(step S40). This reset request is generated from hard- 
ware or software (set of register values) in accordance 
with a picture display designation from the user. 
[0177] When the reset request is made to designate 
display of a new picture, a start signal (|)AGT (1) is 
asserted and supplied to the variable length decoder 
(see Fig. 15) since the picture decoding circuit carries 
out no picture data decoding operation at this time (step 
S41). 

[0178] In response to the assertion of the start sig- 
nal <^ACT (I), the variable length decoder searches for a 
sequence start code. A GOP start code, a picture start 
code and a slice start code are neglected. When a 
sequence start code is detected and a start code indi- 
cating starting of a picture is then detected, information 
of a header part following the start code is analyzed and 
header information of a segment of a macro block layer 
is analyzed (step S42). In the state of having analyzed 
this header information, establishment of prescribed 
conditions is waited (step S43). The prescribed condi- 
tions are identical to those described with reference to 
the step S35 in Fig. 24. Namely, the prescribed condi- 
tions are that a sufficient quantity of bit stream is stored 
in the rate buffer and a vertical synchronizing signal 
supplied from the external display control unit is 
asserted. When the prescribed conditions are estab- 
lished, the control unit asserts a picture synchronizing 
signal indicating starting of a picture, resets a counter 
indicating a macro block address included in its interior, 
asserts an MB synchronizing signal in synchronization 
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with the picture synchronizing signal and makes the pic- 
ture decoding circuit carry out a normal operation (step 
S44). Upon user's reset request, the assertion of the 
IVIB synchronizing signal is made in synchronization 
with the assertion of the picture synchronizing signal, 5 
whereby display picture data can be correctly read in 
synchronization with the vertical synchronizing signal, 
for example, supplied from the external control unit in 
the case of displaying a picture of a new sequence, and 
pixel decoding operations can be successively executed . w 
along the picture display. 

[01 79] The series of processing operations are exe- 
cuted by the initialization control circuit 14 shown in Fig. 
16. The start signal ^ACT is so indicated that the same 
signal is asserted in a reset request designating restart- is 
tng of display and in that designating Initialization of dis- 
play. IHowever, these are different signals, and start 
codes to be searched in restarting and Initialization are 
discriminated in response to the types of the start sig- 
nals (t>ACT, or <|>ACT (R) and (j)ACT (I). 20 
[0180] Fig. 26 illustrates exemplary operations of 
the picture decoding circuit in a reset operation. This fig- 
ure shows such a state that an initialization indication 
(reset indication) instructing picture display is supplied 
from the exterior, for example (see Fig. 25). in this state, 25 
no MB synchronization signal MBSYNC is asserted 
since the picture decoding circuit carries out no pixel 
decoding operation. 

[0181] When a reset request signal <|>RRQ is 
asserted, the start signal <fACT (I) is outputted 30 
(asserted) from the initialization control circuit shown in 
Fig. 16. in response to the assertion of the start signal 
(|)ACT (I), the variable length decoder searches for a 
start code indicating starting of a picture of a sequence 
layer. In this search operation, data are read from the 35 
rate buffer under control by the control unit. If no bit 
stream is yet stored in the rate buffer but the bit stream 
first arrives upon generation of the reset request signal 
<|)RRQ, the control unit directly supplies the bit stream 
supplied through the FIFO interface to the variable 40 
length decoder, to mal^e the same search a start code. 
The variable length decoder analyzes the start code 
detected by the start code detector (see Fig. 15) in the 
control part 6, detects the picture start code indicating 
the starting of the picture subsequently to the detection 45 
of the sequence start code, and analyzes header infor- 
mation subsequent to the detected picture start code. In 
restarting, a start code in a layer above a macro block 
layer is searched and header information is analyzed 
after detection thereof. When the header information of so 
the segment of the macro block layer is completely ana- 
lyzed, the variable length decoder asserts a processing 
unit decoding completion indication signal 4CPL. In 
response to the assertion of the processing unit decod- 
ing completion indication signal <t»CPL, the control unit 55 
waits for establishment of prescribed conditions. When 
the prescribed conditions are established, i.e., when a 
sufficient quantity of bit stream is stored in the rate 



buffer and a vertical synchronizing signal is supplied, 
the control unit asserts the picture synchronizing signal 
PSYNC in its interior, while asserting the MB synchro- 
nizing signal MBSYNC in synchronization with this pic- 
ture synchronizing signal PSYNC. In a first processing 
section, decoding of block data of the segment whose 
header information has been analyzed and analysis of 
header information following this segment are executed. 
Thereafter the MB synchronizing signal MBSYNC is 
asserted every time header information is analyzed in 
each processing section and prescribed conditions are 
established. 

[0182] Due to the series of initialization or reset 
operations, decoding of block data of the segments can 
be reliably started in response to assertion of the MB 
synchronizing signal MBSYNC to implement high speed 
arithmetic processing also in a reset operation including 
an error return operation. 

[0183] In the aforementioned embodiment, decod- 
ing processing of picture data (pixel data) decoded 
along the MPEG standard is described as an example 
of pixel data decoding processing. However, the present 
invention is applicable also where processing is made in 
units of data blocks having certain sizes of variable 
length codes in place of the MPEG standard pixel data, 
if header information is provided in a form of variable 
length codes for the block data. Further, the present 
invention is also applicable to data subjected to orthog- 
onal transformation other than DCT processing. 
[0184] Principal features of the present invention 
are as follows: 

(1) Header information is analyzed following 
processing of a data block in one processing sec- 
tion, and data processing starting is done after all 
analysis of the header information is completed. 
One processing section is started in decoding of 
the data block and ended in analysis of the header 
information. When starting of the data processing is 
designated, therefore, each operational processor 
can immediately execute its processing, whereby 
utilization efficiency of the operational processors is 
improved and the data processing can be executed 
at a high speed. Further, the standby time of the 
operational processor is reduced, whereby the time 
period of one processing section can be reduced. 

(2) The time period of the processing section is 
changed in accordance with the result of analysis of 
the header information. The time period of the 
processing section can be changed depending on 
the attributes of the segment to be processed and 
the optimum length of the processing section can 
be set in accordance with the attributes of the seg- 
ment to be processed. It is possible to prevent such 
a malfunction that a next processing section is 
started before completion of one processing sec- 
tion, which may be caused In the case of a process- 
ing section of a fixed length time, and picture data 
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can be efficiently and correctly processed. 

(3) Access to an external memory is executed in 
parallel with decoding of data block data. An influ- 
ence exerted on pixel data decoding processing by 
the access to the external memory can be elimi- s 
nated, and the processing time can be reduced. 
Further, necessary data can be efficiently supplied 

to a data processing part with no destruction of data 
required for pipeline processing in data processing 
part by carrying out the access to the externa] io 
memory successively in order of writing of restored 
data, writing of an incoming bit stream, reading of 
display picture data, reading of predictive picture 
data and reading of the bit stream. 

(4) When an error occurs in a header information is 
analyzing process or a variable length decoding 
process, a start code having a prescribed pattern is 
detected and header information of a segment fol- 
lowing the start code is analyzed so that processing 

of a data block subsequent to the analyzed header 20 
information is delayed until prescribed conditions 
are satisfied after completion of the analysis. 
Processing can be started at a segment having no 
influence by an error in starting of processing in 
error generation, while the processing is started 25 
from decoding of the data block also in this 
processing starting upon error generation, whereby 
reduction of utilization of each operational proces- 
sor included in data processing part can be sup- 
pressed also after recovery from the error, and data 30 
processing can be executed at a high speed. 

(5) A pipeline is formed having one processing unit 
of a processing section correspond to a segment. 
Reduction of utilization efficiency of a computing 
element of each pipeline can be suppressed to the 35 
minimum and high-speed data processing Is ena- 
bled. Further, one processing unit (segment) can 

be shared by a plurality of processing sections in a 
pipeline manner due to pipeline stages, whereby 
the time period for the processing section can be 40 
reduced and high-speed data processing is ena- 
bled. 

(6) The pipeline stages are formed into a four-stage 
pipeline structure in units of segments in accord- 
ance with the content of the processing. It is possi- 45 
ble to execute a pipeline operation with the 
minimum wait time of each operational processor 
even if the time period of the processing section 
varies, whereby high-speed data processing can be 
carried out Due to the pipeline structure, further, so 
header information can be analyzed in parallel with 
data processing, whereby the time period for the 
processing section can be reduced and high-speed 
data processing is implemented. 

(7) In error processing, block data of a segment ss 
precedent to that having an en-or detected are 
repaired in the pipeline stage, with delay of the 
pipeline stage efficiently utilized, an error repair 



operation can be made on the segment having the 
error caused, and deterioration in quality of a 
decoded picture caused by mixing of an error bit 
can be suppressed. 

(8) When a reset request is made, a start code hav- 
ing a prescribed pattern is searched and a process- 
ing start indication signal is asserted when 
prescribed conditions are established after header 
information of a segment following the start code is 
entirely analyzed, to execute processing of the data 
block of this segment. Processing can be reliably 
executed from the starting of a picture also in reset- 
ting while each operational processor can be imme- 
diately driven in response to the processing starting 
to carry out data processing, whereby high speed 
processing can be carried out. 

(9) Data decoding processing is started In synchro- 
nization with an externally supplied picture synchro- 
nizing signal (vertical synchronizing signal) 
indicating starting of a picture. Also in resetting, a 
correct pixel data processing operation and reading 
of display picture data can be carried out by estab- 
lishing synchronization with the synchronizing sig- 
nal supplied from an external control unit. 

[0185] Although the present Invention has been 
described and illustrated in detail, It is clearly under- 
stood that the same is by way of Illustration and example 
only and is not to be taken by way of limitation, the spirit 
and scope of the present invention being limited only by 
the terms of the appended claims. 

Claims 

1. A picture decoding circuit for extending a moving 
picture compressed in accordance with a predeter- 
mined procedure in units of segments of prescribed 
sizes for restoring decompressed picture data, said 
compressed moving picture being variable length 
encoded, each said segment having a data block 
including data to be processed and a header having 
information indicating attributes of said data of said 
data block, said picture decoding circuit including: 

data processing means (4, 1212, 1216, 1218, 
1220) comprising (t) header decoding means 
including analysis means (3, 6) for detecting a 
header from a supplied bit stream and analyz- 
ing information of said header, said analysis 
means (3, 6), including means (6) generating a 
completion signal ((|» CPL) indicating comple- 
tion of analysis of all said header information, 
(ii) variable length decoding means (4, 1212, 
1214, 1216, 1220) for variable length decoding 
pixel data of a data block of said segment in 
accordance with the result of said analysis of 
said analysis means and forming fixed length 
pixel data and restoring said pixel data of said 



24 



47 



EP 1 085 465 A2 



48 



data block to decompressed pixel data; 
detect means (5,6) coupled to said analysis 
means (3, 6) and said variable length decoding 
means (4, 1212, 1214, 1216, 1220) for gener- 
ating an error detection signal indicating an s 
en-or when said error is detected in processing 
of either said analysis means (3, 6) or said var- 
iable length decoding means (4, 1212, 1214. 
1216, 1220); 

code search means (2, 6) coupled to said io 
detect means (5, 6) for searching for a start 
code having a predetermined pattern from said 
incoming bit stream in response to said error 
detection signal; 

activation means (1226, 6) coupled to said is 
code search means (2, 6) for activating said 
analysis means (3, 6) in response to code 
detection by said code search means (2, 6); 
and 

means (1226, 6) delaying execution of 20 
processing of a data block following a header 
following the start code by said data processing 
means (4, 1212, 1217, 1218, 1220) till estab- 
lishment of a prescribed condition for said 
processing of the data block in response to 25 
said completion signal (<{> CPL) Indicating com- 
pletion of analysis of said information of said 
header following the start code from said anal- 
ysis means (3, 6). 

30 

The picture decoding circuit in accordance with 
claim 1, wherein said data processing means (4, 
1212, 1216, 1218, 1220) includes a plurality of 
pipeline stages performing processing In a pipeline 
manner with said segments as processing units, 35 
wherein one pipeline stage is responsible for each 
said segment, 

wherein said pipeline stages i3referably include: 

a first pipeline stage for carrying out loading of 40 
predictive picture data from a memory device 
(1230), variable length decoding of an orthogo- 
nal transformation coefficient of said data block 
followed by inverse quantization thereof, 
a second pipeline stage for forming a predictive 45 
picture from said loaded predictive picture pixel 
data, 

a third pipeline stage for carrying out inverse 
orthogonal transformation processing of the 
inverse quantized pixel data and restoration of so 
said pixel data of said data block from said pre- 
dictive picture pixel data and said inverse 
orthogonal transformation processed pixel 
data, and 

a fourth pipeline stage for writing said restored ss 
pixel data in said memory device and/or means 
(1226, 1216, 1220) responsive to an error 
detection signal for carrying out prescribed 



error repair processing in said pipeline stages 
from a data block of a segment being posi- 
tioned in front of a segment at which said error 
is detected in a processing order in said data 
processing means (4, 1212, 1216, 1214, 1218, 
1220). 

L A picture decoding circuit for extending a moving 
picture compressed in accordance with a predeter- 
mined procedure in units of segments of prescribed 
sizes for restoring decompressed picture pixel data, 
said compressed moving picture being variable 
length encoded, each said segment having a data 
block including pixel data following a header indicat- 
ing attributes of said data block, said picture decod- 
ing circuit including: 

analysis means (3, 6) coupled to receive a bit 
stream for analyzing information included in a 
header of a segment included in the supplied 
bit stream; 

data processing means (4, 1212, 1214, 1216, 
1218, 1220) including variable length decoding 
means (4) for performing variable length 
decoding processing on data of a data block 
following the header in accordance with the 
result of said analysis of said header decoding 
means (3, 6), for restoring said data of said 
data block to original picture data; 
search means (2, 6) for searching for a start 
code having a prescribed pattern in the sup- 
plied bit stream in response to a start signal; 
means (6, 11, 14) generating said start signal 
for starting said search means (2, 6) In 
response to a reset request signal; 
means (6, 11, 14) for activating said header 
decoding means (3, 6) in response to detection 
of said start code by said search means (2, 6); 
and 

means (11, 12, 15, 16) delaying execution of 
processing of a data block following a header 
following said start code by said data process- 
ing means (4, 1212, 1214. 1216, 1218, 1220) 
till establishment of a prescribed condition for 
said processing of the data block, in response 
to a completion signal (<}> CPL) indicating com- 
pletion of analysis of said information of said 
header following the start code from said 
header decoding means (3, 6). 

. The picture decoding circuit in accordance with 
claim 3, wherein said prescribed condition is appli- 
cation of synchronizing signal (PSYNC) indication a 
start point of a picture to be displayed. 
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